Skip to main content

Qwen2 Instruct 72B

AlibabaQwenOpen Weighttongyi-qianwen

Description

Qwen2-72B-Instruct is an instruction-tuned language model with 72 billion parameters, supporting a context length of up to 131,072 tokens. It's part of the new Qwen2 series, which has surpassed most open-source models and demonstrates competitiveness against proprietary models across various benchmarks.

Release Date
2024-06-07
Parameters
72.0B
Context Length
Modalities

Capability Radar

26
general
17
coding
36
reasoning
25
scienceest.
0
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking372
17.0
AA
General Ranking364
31.0
AA
Math Reasoning217
42.0
AA
Reasoning14
88.0
LS
Science387
26.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA42.4%SR

Code

HumanEval86.0%SR
EvalPlus0.79 / 100SR

Finance

MMLU82.3%SR
MMLU-Pro64.4%SR
TruthfulQA54.8%SR
TheoremQA44.4%SR

General

CMMLU90.1%SR
C-Eval83.8%SR
MBPP0.80 / 100SR
MultiPL-E69.2%SR
ARC-C68.9%SR

Language

Winogrande85.1%SR
BBH82.4%SR

Math

GSM8k91.1%SR
MATH59.7%SR

Reasoning

HellaSwag87.6%SR

AA Evaluation Indices

Intelligence Index
11.7
Math 500
0.7
Mmlu Pro
0.6
Gpqa
0.4
Scicode
0.2
Livecodebench
0.2
Aime
0.1
Hle
0.0

LLM Stats Category Scores

Code
80
Language
80
General
70
Healthcare
70
Legal
70
Math
70
Reasoning
70
Finance
60
Biology
40
Chemistry
40
Physics
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s

Available Providers

(LS internal units)

No provider data available

External Sources