Skip to main content

Llama 3.1 Nemotron Instruct 70B

NVIDIALlamaOpen WeightLlama 3.1 Community License

Description

A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.

Release Date
2024-10-15
Parameters
70.0B
Context Length
128K
Modalities
text

Capability Radar

70
general
0
coding
90
reasoning
60
scienceest.
63
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

MT-Bench0.09 / 100SR

General

MMLU80.2%SR
Instruct HumanEval73.8%SR
TruthfulQA58.6%SR

Language

MMLU Chat80.6%SR

Math

GSM8k91.4%SR
GSM8K Chat81.9%SR

Reasoning

HellaSwagAI2 (2019)85.6%SR
Winogrande84.5%SR
ARC-C69.2%SR

Summarization

XLSum English31.6%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
90
Language
80
Legal
70
Reasoning
70
Finance
70
General
70
Healthcare
70
Chat
10
Roleplay
10
Communication
10
Creativity
10

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

No speed data available

Provider Price Ranking

No provider data available

External Sources