Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
NVIDIALlamaOpen WeightLlama 3.1 Community License
Description
A 253B parameter derivative of Meta Llama 3.1 405B Instruct, developed by NVIDIA using Neural Architecture Search (NAS) and vertical compression. It underwent multi-phase post-training (SFT for Math, Code, Reasoning, Chat, Tool Calling; RL with GRPO) to enhance reasoning and instruction-following. Optimized for accuracy/efficiency tradeoff on NVIDIA GPUs. Supports 128k context.
Release Date
2025-04-07
Parameters
253.0B
Context Length
—
Modalities
—
Capability Radar
34
general
33
coding
72
reasoning
47
scienceest.
70
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 290 | 26.0 | AA |
| General Ranking | 298 | 36.0 | AA |
| Math Reasoning | 108 | 73.0 | AA |
| Science | 177 | 50.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
76.0%SR
Code
LiveCodeBench
66.3%SR
General
IFEval
89.5%SR
BFCL v2
74.1%SR
Math
MATH-500
97.0%SR
AIME 2025
72.5%SR
AA Evaluation Indices
Math Index63.7
Intelligence Index15.0
Coding Index13.1
Math 5001.0
Mmlu Pro0.8
Aime0.7
Gpqa0.7
Livecodebench0.6
Aime 250.6
Ifbench0.4
Scicode0.3
Tau20.1
Hle0.1
Lcr0.1
Terminalbench Hard0.0
LLM Stats Category Scores
Structured Output90
Instruction Following90
Biology80
Chemistry80
General80
Math80
Physics80
Reasoning80
Tool Calling70
Code70
Pricing
Input Price$0.6 / 1M tokens
Output Price$1.8 / 1M tokens
Blended Price (3:1)$0.9 / 1M tokens
Speed
Tokens/sec40.9 tokens/s
Time to First Token0.75s
Time to Answer49.64s
Available Providers
(LS internal units)No provider data available