Qwen2.5 Coder Instruct 7B
AlibabaQwenOpen WeightApache 2.0 · Commercial OK
Description
Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, and repair while maintaining strong performance in math and general tasks. The model demonstrates exceptional capabilities in multi-programming language tasks and code reasoning.
Release Date
2024-09-19
Parameters
7.0B
Context Length
—
Modalities
—
Capability Radar
60
general
50
coding
60
reasoning
26
scienceest.
57
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
67.6%SR
TruthfulQA
50.6%SR
BigCodeBench
41.0%SR
Language
MMLU-Base
68.0%SR
MMLU-Redux
66.6%SR
MMLU-Pro
40.1%SR
Math
GSM8k
83.9%SR
MATH
46.6%SR
TheoremQA
34.0%SR
STEM
34.0%SR
Reasoning
HumanEvalOpenAI (2021)
88.4%SR
MBPP
0.83 / 100SR
HellaSwagAI2 (2019)
76.8%SR
Winogrande
72.9%SR
ARC-C
60.9%SR
CRUXEval-Input-CoT
56.5%SR
CRUXEval-Output-CoT
56.0%SR
Aider
55.6%SR
LiveCodeBench
18.2%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Language60
Math60
Reasoning60
General60
Legal50
Finance50
Healthcare50
Code50
Physics30
Pricing
No pricing data available
Speed
No speed data available
Provider Price Ranking
No provider data available