Saltar al contenido principal

Qwen2 Instruct 72B

AlibabaQwenOpen Weighttongyi-qianwen

Descripción

Qwen2-72B-Instruct is an instruction-tuned language model with 72 billion parameters, supporting a context length of up to 131,072 tokens. It's part of the new Qwen2 series, which has surpassed most open-source models and demonstrates competitiveness against proprietary models across various benchmarks.

Fecha de lanzamiento
2024-06-07
Parámetros
72.0B
Longitud del contexto
—
Modalidades
—

Radar de capacidades

23
general
16
coding
36
reasoning
27
science
30
agents
0
multimodal

Rankings

Dominio#PosiciónPuntuaciónFuente
Ranking de codificación533
17.0
AA
Ranking general525
26.0
AA
Ciencia582
18.0
AA

Puntuaciones de benchmarks (LLM Stats)

(LLM Stats (zeroeval))

General

C-Eval83.8%Aut.
MMLU82.3%Aut.
MultiPL-E69.2%Aut.
TruthfulQA54.8%Aut.

Language

CMMLU90.1%Aut.
MMLU-Pro64.4%Aut.

Math

GSM8k91.1%Aut.
MATH59.7%Aut.
TheoremQA44.4%Aut.

Reasoning

HellaSwagAI2 (2019)87.6%Aut.
HumanEvalOpenAI (2021)86.0%Aut.
Winogrande85.1%Aut.
BBH82.4%Aut.
MBPP0.80 / 100Aut.
EvalPlus0.79 / 100Aut.
ARC-C68.9%Aut.
GPQANYU + Cohere + Anthropic (2023)42.4%Aut.

Índices de evaluación AA

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
70.1
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
62.2
Gpqa(NYU + Cohere + Anthropic (2023))
37.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))
15.9
Aime(MAA (Mathematical Association of America))
14.7
Intelligence Index(Artificial Analysis)
6.3
Hle(Center for AI Safety + Scale AI (2025))
3.7

Puntuaciones por categoría LLM Stats

(LLM Stats (zeroeval))
Language
80
Code
80
Legal
70
Math
70
Reasoning
70
General
70
Healthcare
70
Finance
60
Physics
40
Biology
40
Chemistry
40

Precios

Precio de entradaGratis
Precio de salidaGratis
Precio mixto (3:1)Gratis

Velocidad

Tokens/seg0.0
Retraso del primer token0.00s
Tiempo hasta la respuesta0.00s

Ranking de Precios por Proveedor

No hay datos de proveedores disponibles

Fuentes externas