Skip to main content

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)

NVIDIALlamaOpen WeightLlama 3.1 Community License

Description

A 253B parameter derivative of Meta Llama 3.1 405B Instruct, developed by NVIDIA using Neural Architecture Search (NAS) and vertical compression. It underwent multi-phase post-training (SFT for Math, Code, Reasoning, Chat, Tool Calling; RL with GRPO) to enhance reasoning and instruction-following. Optimized for accuracy/efficiency tradeoff on NVIDIA GPUs. Supports 128k context.

Release Date
2025-04-07
Parameters
253.0B
Context Length
Modalities

Capability Radar

34
general
33
coding
72
reasoning
47
scienceest.
70
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking290
26.0
AA
General Ranking298
36.0
AA
Math Reasoning108
73.0
AA
Science177
50.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA76.0%SR

Code

LiveCodeBench66.3%SR

General

IFEval89.5%SR
BFCL v274.1%SR

Math

MATH-50097.0%SR
AIME 202572.5%SR

AA Evaluation Indices

Math Index
63.7
Intelligence Index
15.0
Coding Index
13.1
Math 500
1.0
Mmlu Pro
0.8
Aime
0.7
Gpqa
0.7
Livecodebench
0.6
Aime 25
0.6
Ifbench
0.4
Scicode
0.3
Tau2
0.1
Hle
0.1
Lcr
0.1
Terminalbench Hard
0.0

LLM Stats Category Scores

Structured Output
90
Instruction Following
90
Biology
80
Chemistry
80
General
80
Math
80
Physics
80
Reasoning
80
Tool Calling
70
Code
70

Pricing

Input Price$0.6 / 1M tokens
Output Price$1.8 / 1M tokens
Blended Price (3:1)$0.9 / 1M tokens

Speed

Tokens/sec40.9 tokens/s
Time to First Token0.75s
Time to Answer49.64s

Available Providers

(LS internal units)

No provider data available

External Sources