Llama 3.1 Nemotron Instruct 70B
NVIDIALlamaOpen WeightLlama 3.1 Community License
Descripción
A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.
Fecha de lanzamiento
2024-10-15
Parámetros
70.0B
Longitud del contexto
128K
Modalidades
text
Radar de capacidades
25
general
18
coding
27
reasoning
30
science
24
agents
0
multimodal
Rankings
| Dominio | #Posición | Puntuación | Fuente |
|---|---|---|---|
| Ranking de codificación | 498 | 11.0 | AA |
| Ranking general | 433 | 29.0 | AA |
| Ciencia | 440 | 29.0 | AA |
Puntuaciones de benchmarks (LLM Stats)
(LLM Stats (zeroeval))Communication
MT-Bench
0.09 / 100Aut.
Finance
MMLU Chat
80.6%Aut.
MMLU
80.2%Aut.
TruthfulQA
58.6%Aut.
General
Instruct HumanEval
73.8%Aut.
ARC-C
69.2%Aut.
Language
Winogrande
84.5%Aut.
XLSum English
31.6%Aut.
Math
GSM8k
91.4%Aut.
GSM8K Chat
81.9%Aut.
Reasoning
HellaSwagAI2 (2019)
85.6%Aut.
Índices de evaluación AA
(Artificial Analysis)Math Index(Artificial Analysis)11.0
Intelligence Index(Artificial Analysis)7.4
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.5
Ifbench(Google Research (2023))0.3
Aime(MAA (Mathematical Association of America))0.2
Scicode(UIUC + Argonne National Lab (2024))0.2
Tau2(Sierra + U Toronto + Vector Institute (2025))0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.2
Aime 25(MAA (Mathematical Association of America))0.1
Lcr(Artificial Analysis)0.1
Terminalbench Hard(Stanford × Laude Institute (2026))0.0
Hle(Center for AI Safety + Scale AI (2025))0.0
Puntuaciones por categoría LLM Stats
(LLM Stats (zeroeval))Math90
Language80
Legal70
Reasoning70
Finance70
General70
Healthcare70
Roleplay10
Communication10
Creativity10
Precios
Precio de entrada$1.2 / 1M tokens
Precio de salida$1.2 / 1M tokens
Precio mixto (3:1)$1.2 / 1M tokens
Velocidad
Tokens/seg82.3
Retraso del primer token5.52s
Tiempo hasta la respuesta5.52s
Ranking de Precios por Proveedor
Ranking de Precios por Proveedor
1 proveedores
ProveedorEntradaSalida
1NVIDIAPRINCIPAL
$1.2
$1.2
Comparar precios entre diferentes proveedores de API para este modelo.