Skip to main content

Qwen2.5 Coder Instruct 7B

AlibabaQwenOpen WeightApache 2.0 · Commercial OK

Description

Qwen2.5-Coder is a specialized coding model trained on 5.5 trillion tokens of code data, supporting 92 programming languages with a 128K context window. It excels in code generation, completion, and repair while maintaining strong performance in math and general tasks. The model demonstrates exceptional capabilities in multi-programming language tasks and code reasoning.

Release Date
2024-09-19
Parameters
7.0B
Context Length
—
Modalities
—

Capability Radar

60
general
50
coding
60
reasoning
26
scienceest.
57
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU67.6%SR
TruthfulQA50.6%SR
BigCodeBench41.0%SR

Language

MMLU-Base68.0%SR
MMLU-Redux66.6%SR
MMLU-Pro40.1%SR

Math

GSM8k83.9%SR
MATH46.6%SR
TheoremQA34.0%SR
STEM34.0%SR

Reasoning

HumanEvalOpenAI (2021)88.4%SR
MBPP0.83 / 100SR
HellaSwagAI2 (2019)76.8%SR
Winogrande72.9%SR
ARC-C60.9%SR
CRUXEval-Input-CoT56.5%SR
CRUXEval-Output-CoT56.0%SR
Aider55.6%SR
LiveCodeBench18.2%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
60
Math
60
Reasoning
60
General
60
Legal
50
Finance
50
Healthcare
50
Code
50
Physics
30

Pricing

No pricing data available

Speed

No speed data available

Provider Price Ranking

No provider data available

External Sources