Llama 3.1 Nemotron Instruct 70B
NVIDIALlamaOpen WeightLlama 3.1 Community License
Description
A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.
Release Date
2024-10-15
Parameters
70.0B
Context Length
128K
Modalities
text
Capability Radar
70
general
0
coding
90
reasoning
60
scienceest.
63
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
MT-Bench
0.09 / 100SR
General
MMLU
80.2%SR
Instruct HumanEval
73.8%SR
TruthfulQA
58.6%SR
Language
MMLU Chat
80.6%SR
Math
GSM8k
91.4%SR
GSM8K Chat
81.9%SR
Reasoning
HellaSwagAI2 (2019)
85.6%SR
Winogrande
84.5%SR
ARC-C
69.2%SR
Summarization
XLSum English
31.6%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Math90
Language80
Legal70
Reasoning70
Finance70
General70
Healthcare70
Chat10
Roleplay10
Communication10
Creativity10
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
No speed data available
Provider Price Ranking
No provider data available