Skip to main content
AITier

Qwen2.5 Coder Instruct 7B

AlibabaQwenOpen WeightApache 2.0 · Commercial OK

Description

Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, and repair while maintaining strong performance in math and general tasks. The model demonstrates exceptional capabilities in multi-programming language tasks and code reasoning.

Release Date
2024-09-19
Parameters
7.0B
Context Length
131K
Modalities
text

Capability Radar

17
general
13
coding
29
reasoning
21
science
24
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking480
14.0
AA
General Ranking517
20.0
AA
Science509
20.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Code

HumanEvalOpenAI (2021)88.4%SR
Aider55.6%SR
LiveCodeBench18.2%SR

Finance

MMLU-Base68.0%SR
MMLU67.6%SR
TruthfulQA50.6%SR
MMLU-Pro40.1%SR
TheoremQA34.0%SR

General

MBPP0.83 / 100SR
MMLU-Redux66.6%SR
ARC-C60.9%SR
BigCodeBench41.0%SR

Language

Winogrande72.9%SR

Math

GSM8k83.9%SR
MATH46.6%SR
STEM34.0%SR

Reasoning

HellaSwagAI2 (2019)76.8%SR
CRUXEval-Input-CoT56.5%SR
CRUXEval-Output-CoT56.0%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
4.1
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.5
Gpqa(NYU + Cohere + Anthropic (2023))
0.3
Scicode(UIUC + Argonne National Lab (2024))
0.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.1
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
60
Reasoning
60
Language
60
General
60
Legal
50
Finance
50
Healthcare
50
Code
50
Physics
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Alibaba (China)
$0.144
$0.287

Compare pricing across different API providers for this model.

External Sources

LLM StatsArtificial Analysis