Skip to main content

Llama 3.1 Nemotron Instruct 70B

NVIDIALlamaOpen WeightLlama 3.1 Community License

Description

A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.

Release Date
2024-10-15
Parameters
70.0B
Context Length
128K
Modalities
text

Capability Radar

25
general
18
coding
27
reasoning
30
science
24
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking489
11.0
AA
General Ranking423
29.0
AA
Science430
29.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Communication

MT-Bench0.09 / 100SR

Finance

MMLU Chat80.6%SR
MMLU80.2%SR
TruthfulQA58.6%SR

General

Instruct HumanEval73.8%SR
ARC-C69.2%SR

Language

Winogrande84.5%SR
XLSum English31.6%SR

Math

GSM8k91.4%SR
GSM8K Chat81.9%SR

Reasoning

HellaSwagAI2 (2019)85.6%SR

AA Evaluation Indices

(Artificial Analysis)
Math Index(Artificial Analysis)
11.0
Intelligence Index(Artificial Analysis)
7.4
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.7
Gpqa(NYU + Cohere + Anthropic (2023))
0.5
Ifbench(Google Research (2023))
0.3
Aime(MAA (Mathematical Association of America))
0.2
Scicode(UIUC + Argonne National Lab (2024))
0.2
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.2
Aime 25(MAA (Mathematical Association of America))
0.1
Lcr(Artificial Analysis)
0.1
Terminalbench Hard(Stanford × Laude Institute (2026))
0.0
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
90
Language
80
Legal
70
Reasoning
70
Finance
70
General
70
Healthcare
70
Roleplay
10
Communication
10
Creativity
10

Pricing

Input Price$1.2 / 1M tokens
Output Price$1.2 / 1M tokens
Blended Price (3:1)$1.2 / 1M tokens

Speed

Tokens/sec80.2
Time to First Token4.82s
Time to Answer4.82s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1NVIDIAPRIMARY
$1.2
$1.2

Compare pricing across different API providers for this model.

External Sources