Passer au contenu principal

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)

NVIDIALlamaOpen WeightLlama 3.1 Community License

Description

A 253B parameter derivative of Meta Llama 3.1 405B Instruct, developed by NVIDIA using Neural Architecture Search (NAS) and vertical compression. It underwent multi-phase post-training (SFT for Math, Code, Reasoning, Chat, Tool Calling; RL with GRPO) to enhance reasoning and instruction-following. Optimized for accuracy/efficiency tradeoff on NVIDIA GPUs. Supports 128k context.

Date de sortie
2025-04-07
Paramètres
253.0B
Longueur du contexte
128K
Modalités
text

Radar de capacités

30
general
64
coding
72
reasoning
53
science
70
agents
0
multimodal

Classements

Domaine#RangScoreSource
Classement codage387
37.0
AA
Classement général458
31.0
AA
Science356
42.0
AA

Scores de benchmarks (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)89.5%Aut.

General

BFCL v274.1%Aut.

Math

MATH-50097.0%Aut.
AIME 202572.5%Aut.

Reasoning

GPQANYU + Cohere + Anthropic (2023)76.0%Aut.
LiveCodeBench66.3%Aut.

Indices d'évaluation AA

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
95.2
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
82.5
Aime(MAA (Mathematical Association of America))
74.7
Gpqa(NYU + Cohere + Anthropic (2023))
72.8
Livecodebench(UC Berkeley + MIT + Cornell (2024))
64.1
Math Index(Artificial Analysis)
63.7
Aime 25(MAA (Mathematical Association of America))
63.7
Ifbench(Google Research (2023))
38.2
Tau2(Sierra + U Toronto + Vector Institute (2025))
11.4
Intelligence Index(Artificial Analysis)
7.5
Hle(Center for AI Safety + Scale AI (2025))
7.4
Terminalbench Hard(Stanford × Laude Institute (2026))
2.3

Scores par catégorie LLM Stats

(LLM Stats (zeroeval))
Chat
90
Instruction Following
90
Structured Output
90
Math
80
Physics
80
Reasoning
80
General
80
Biology
80
Chemistry
80
Code
70
Tool Calling
70

Tarification

Prix d'entréeGratuit
Prix de sortieGratuit
Prix mixte (3:1)Gratuit

Vitesse

Tokens/sec0.0
Délai du premier token0.00s
Temps de réponse0.00s

Classement des Prix par Fournisseur

Aucune donnée de fournisseur disponible

Sources externes