Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
NVIDIALlamaOpen WeightLlama 3.1 Community License
Description
A 253B parameter derivative of Meta Llama 3.1 405B Instruct, developed by NVIDIA using Neural Architecture Search (NAS) and vertical compression. It underwent multi-phase post-training (SFT for Math, Code, Reasoning, Chat, Tool Calling; RL with GRPO) to enhance reasoning and instruction-following. Optimized for accuracy/efficiency tradeoff on NVIDIA GPUs. Supports 128k context.
Release Date
2025-04-07
Parameters
253.0B
Context Length
128K
Modalities
text
Capability Radar
31
general
58
coding
72
reasoning
46
science
70
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 371 | 27.0 | AA |
| General Ranking | 385 | 33.0 | AA |
| Science | 258 | 48.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
76.0%SR
Code
LiveCodeBench
66.3%SR
General
IFEvalGoogle Research (2023)
89.5%SR
BFCL v2
74.1%SR
Math
MATH-500
97.0%SR
AIME 2025
72.5%SR
AA Evaluation Indices
(Artificial Analysis)Math Index(Artificial Analysis)63.7
Intelligence Index(Artificial Analysis)8.9
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))1.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.8
Aime(MAA (Mathematical Association of America))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.7
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.6
Aime 25(MAA (Mathematical Association of America))0.6
Ifbench(Google Research (2023))0.4
Scicode(UIUC + Argonne National Lab (2024))0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))0.1
Lcr(Artificial Analysis)0.1
Hle(Center for AI Safety + Scale AI (2025))0.1
Terminalbench Hard(Stanford × Laude Institute (2026))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Structured Output90
Instruction Following90
Math80
Physics80
Reasoning80
General80
Biology80
Chemistry80
Code70
Tool Calling70
Pricing
Input Price$0.6 / 1M tokens
Output Price$1.8 / 1M tokens
Blended Price (3:1)$0.9 / 1M tokens
Speed
Tokens/sec53.0
Time to First Token0.68s
Time to Answer38.40s
Provider Price Ranking
Provider Price Ranking
1 providers
ProviderInputOutput
1NVIDIAPRIMARY
$0.6
$1.8
Compare pricing across different API providers for this model.