Skip to main content

Qwen2.5 Coder Instruct 7B

AlibabaQwenOpen WeightApache 2.0 · Commercial OK

Description

Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, and repair while maintaining strong performance in math and general tasks. The model demonstrates exceptional capabilities in multi-programming language tasks and code reasoning.

Release Date
2024-09-19
Parameters
7.0B
Context Length
131K
Modalities
text

Capability Radar

18
general
13
coding
29
reasoning
25
science
24
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking555
14.0
AA
General Ranking578
20.0
AA
Science584
17.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU67.6%SR
TruthfulQA50.6%SR
BigCodeBench41.0%SR

Language

MMLU-Base68.0%SR
MMLU-Redux66.6%SR
MMLU-Pro40.1%SR

Math

GSM8k83.9%SR
MATH46.6%SR
TheoremQA34.0%SR
STEM34.0%SR

Reasoning

HumanEvalOpenAI (2021)88.4%SR
MBPP0.83 / 100SR
HellaSwagAI2 (2019)76.8%SR
Winogrande72.9%SR
ARC-C60.9%SR
CRUXEval-Input-CoT56.5%SR
CRUXEval-Output-CoT56.0%SR
Aider55.6%SR
LiveCodeBench18.2%SR

AA Evaluation Indices

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
66.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
47.3
Gpqa(NYU + Cohere + Anthropic (2023))
33.9
Livecodebench(UC Berkeley + MIT + Cornell (2024))
12.6
Intelligence Index(Artificial Analysis)
5.8
Aime(MAA (Mathematical Association of America))
5.3
Hle(Center for AI Safety + Scale AI (2025))
4.9

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
60
Math
60
Reasoning
60
General
60
Legal
50
Finance
50
Healthcare
50
Code
50
Physics
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Alibaba (China)
$0.144
$0.287

Compare pricing across different API providers for this model.

External Sources