Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
NVIDIALlamaOpen WeightLlama 3.1 Community License
Descripción
A 253B parameter derivative of Meta Llama 3.1 405B Instruct, developed by NVIDIA using Neural Architecture Search (NAS) and vertical compression. It underwent multi-phase post-training (SFT for Math, Code, Reasoning, Chat, Tool Calling; RL with GRPO) to enhance reasoning and instruction-following. Optimized for accuracy/efficiency tradeoff on NVIDIA GPUs. Supports 128k context.
Fecha de lanzamiento
2025-04-07
Parámetros
253.0B
Longitud del contexto
128K
Modalidades
text
Radar de capacidades
30
general
64
coding
72
reasoning
53
science
70
agents
0
multimodal
Rankings
| Dominio | #Posición | Puntuación | Fuente |
|---|---|---|---|
| Ranking de codificación | 377 | 37.0 | AA |
| Ranking general | 449 | 31.0 | AA |
| Ciencia | 347 | 42.0 | AA |
Puntuaciones de benchmarks (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
89.5%Aut.
General
BFCL v2
74.1%Aut.
Math
MATH-500
97.0%Aut.
AIME 2025
72.5%Aut.
Reasoning
GPQANYU + Cohere + Anthropic (2023)
76.0%Aut.
LiveCodeBench
66.3%Aut.
Índices de evaluación AA
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))95.2
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))82.5
Aime(MAA (Mathematical Association of America))74.7
Gpqa(NYU + Cohere + Anthropic (2023))72.8
Livecodebench(UC Berkeley + MIT + Cornell (2024))64.1
Math Index(Artificial Analysis)63.7
Aime 25(MAA (Mathematical Association of America))63.7
Ifbench(Google Research (2023))38.2
Tau2(Sierra + U Toronto + Vector Institute (2025))11.4
Intelligence Index(Artificial Analysis)7.5
Hle(Center for AI Safety + Scale AI (2025))7.4
Terminalbench Hard(Stanford × Laude Institute (2026))2.3
Puntuaciones por categoría LLM Stats
(LLM Stats (zeroeval))Chat90
Instruction Following90
Structured Output90
Math80
Physics80
Reasoning80
General80
Biology80
Chemistry80
Code70
Tool Calling70
Precios
Precio de entradaGratis
Precio de salidaGratis
Precio mixto (3:1)Gratis
Velocidad
Tokens/seg0.0
Retraso del primer token0.00s
Tiempo hasta la respuesta0.00s
Ranking de Precios por Proveedor
No hay datos de proveedores disponibles