Qwen2.5 Coder Instruct 7B
AlibabaQwenOpen WeightApache 2.0 · Commercial OK
Description
Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, and repair while maintaining strong performance in math and general tasks. The model demonstrates exceptional capabilities in multi-programming language tasks and code reasoning.
Release Date
2024-09-19
Parameters
7.0B
Context Length
131K
Modalities
text
Capability Radar
18
general
13
coding
29
reasoning
25
science
24
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 555 | 14.0 | AA |
| General Ranking | 578 | 20.0 | AA |
| Science | 584 | 17.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
67.6%SR
TruthfulQA
50.6%SR
BigCodeBench
41.0%SR
Language
MMLU-Base
68.0%SR
MMLU-Redux
66.6%SR
MMLU-Pro
40.1%SR
Math
GSM8k
83.9%SR
MATH
46.6%SR
TheoremQA
34.0%SR
STEM
34.0%SR
Reasoning
HumanEvalOpenAI (2021)
88.4%SR
MBPP
0.83 / 100SR
HellaSwagAI2 (2019)
76.8%SR
Winogrande
72.9%SR
ARC-C
60.9%SR
CRUXEval-Input-CoT
56.5%SR
CRUXEval-Output-CoT
56.0%SR
Aider
55.6%SR
LiveCodeBench
18.2%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))66.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))47.3
Gpqa(NYU + Cohere + Anthropic (2023))33.9
Livecodebench(UC Berkeley + MIT + Cornell (2024))12.6
Intelligence Index(Artificial Analysis)5.8
Aime(MAA (Mathematical Association of America))5.3
Hle(Center for AI Safety + Scale AI (2025))4.9
LLM Stats Category Scores
(LLM Stats (zeroeval))Language60
Math60
Reasoning60
General60
Legal50
Finance50
Healthcare50
Code50
Physics30
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
1 providers
ProviderInputOutput
1Alibaba (China)
$0.144
$0.287
Compare pricing across different API providers for this model.