Skip to main content

Qwen2.5 Coder Instruct 32B

AlibabaQwenOpen WeightApache 2.0 · Commercial OK

Description

Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, repair, and multi-programming tasks while maintaining strong performance in mathematics and general capabilities.

Release Date
2024-11-11
Parameters
32.0B
Context Length
33K
Modalities
text

Capability Radar

23
general
29
coding
37
reasoning
29
science
35
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking340
32.0
AA
General Ranking427
30.0
AA
Science448
29.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Code

HumanEvalOpenAI (2021)92.7%SR
LiveCodeBench31.4%SR

Finance

MMLU75.1%SR
TruthfulQA54.2%SR
MMLU-Pro50.4%SR
TheoremQA43.1%SR

General

MBPP0.90 / 100SR
MMLU-Redux77.5%SR
ARC-C70.5%SR
BigCodeBench-Full49.6%SR
BigCodeBench-Hard27.0%SR

Language

Winogrande80.8%SR

Math

GSM8k91.1%SR
MATH57.2%SR

Reasoning

HellaSwagAI2 (2019)83.0%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
6.9
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.8
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.6
Gpqa(NYU + Cohere + Anthropic (2023))
0.4
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.3
Scicode(UIUC + Argonne National Lab (2024))
0.3
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
70
Reasoning
70
Language
70
General
70
Legal
60
Finance
60
Healthcare
60
Code
60
Physics
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

3 providers

Cheapest: Alibaba (China)Most Expensive: Kilo Gateway
ProviderInputOutput
1Alibaba (China)Cheapest
$0.287
$0.861
2OpenRouter
$0.66
$1
3Kilo Gateway
$0.66
$1

Compare pricing across different API providers for this model.

External Sources