Qwen2 Instruct 72B
AlibabaQwenOpen Weighttongyi-qianwen
Description
Qwen2-72B-Instruct is an instruction-tuned language model with 72 billion parameters, supporting a context length of up to 131,072 tokens. It's part of the new Qwen2 series, which has surpassed most open-source models and demonstrates competitiveness against proprietary models across various benchmarks.
Release Date
2024-06-07
Parameters
72.0B
Context Length
—
Modalities
—
Capability Radar
26
general
17
coding
36
reasoning
25
scienceest.
0
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 372 | 17.0 | AA |
| General Ranking | 364 | 31.0 | AA |
| Math Reasoning | 217 | 42.0 | AA |
| Reasoning | 14 | 88.0 | LS |
| Science | 387 | 26.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
42.4%SR
Code
HumanEval
86.0%SR
EvalPlus
0.79 / 100SR
Finance
MMLU
82.3%SR
MMLU-Pro
64.4%SR
TruthfulQA
54.8%SR
TheoremQA
44.4%SR
General
CMMLU
90.1%SR
C-Eval
83.8%SR
MBPP
0.80 / 100SR
MultiPL-E
69.2%SR
ARC-C
68.9%SR
Language
Winogrande
85.1%SR
BBH
82.4%SR
Math
GSM8k
91.1%SR
MATH
59.7%SR
Reasoning
HellaSwag
87.6%SR
AA Evaluation Indices
Intelligence Index11.7
Math 5000.7
Mmlu Pro0.6
Gpqa0.4
Scicode0.2
Livecodebench0.2
Aime0.1
Hle0.0
LLM Stats Category Scores
Code80
Language80
General70
Healthcare70
Legal70
Math70
Reasoning70
Finance60
Biology40
Chemistry40
Physics40
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s
Available Providers
(LS internal units)No provider data available