Skip to main content

Qwen2 Instruct 72B

AlibabaQwenOpen Weighttongyi-qianwen

Description

Qwen2-72B-Instruct is an instruction-tuned language model with 72 billion parameters, supporting a context length of up to 131,072 tokens. It's part of the new Qwen2 series, which has surpassed most open-source models and demonstrates competitiveness against proprietary models across various benchmarks.

Release Date
2024-06-07
Parameters
72.0B
Context Length
Modalities

Capability Radar

22
general
17
coding
36
reasoning
25
science
30
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking454
17.0
AA
General Ranking453
28.0
AA
Science475
25.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)42.4%SR

Code

HumanEvalOpenAI (2021)86.0%SR
EvalPlus0.79 / 100SR

Finance

MMLU82.3%SR
MMLU-Pro64.4%SR
TruthfulQA54.8%SR
TheoremQA44.4%SR

General

CMMLU90.1%SR
C-Eval83.8%SR
MBPP0.80 / 100SR
MultiPL-E69.2%SR
ARC-C68.9%SR

Language

Winogrande85.1%SR
BBH82.4%SR

Math

GSM8k91.1%SR
MATH59.7%SR

Reasoning

HellaSwagAI2 (2019)87.6%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
5.7
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.6
Gpqa(NYU + Cohere + Anthropic (2023))
0.4
Scicode(UIUC + Argonne National Lab (2024))
0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.2
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
80
Code
80
Legal
70
Math
70
Reasoning
70
General
70
Healthcare
70
Finance
60
Physics
40
Biology
40
Chemistry
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources