Llama 3.1 Nemotron Instruct 70B

NVIDIALlama开源权重Llama 3.1 Community License

描述

A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.

发布日期

2024-10-15

参数规模

70.0B

上下文长度

128K

支持模态

text

能力雷达图

general

coding

reasoning

science

agents

multimodal

排行榜排名

领域	#排名	分数	来源
代码能力榜	569	11.0	AA
通用能力榜	496	28.0	AA
科学能力	523	24.0	AA

基准测试分数 (LLM Stats)

(LLM Stats (zeroeval))

Chat

MT-Bench

0.09 / 100自报

General

MMLU

80.2%自报

Instruct HumanEval

73.8%自报

TruthfulQA

58.6%自报

Language

MMLU Chat

80.6%自报

Math

GSM8k

91.4%自报

GSM8K Chat

81.9%自报

Reasoning

HellaSwagAI2 (2019)

85.6%自报

Winogrande

84.5%自报

ARC-C

69.2%自报

Summarization

XLSum English

31.6%自报

AA 评测指数

(Artificial Analysis)

Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))

73.3

Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))

69.0

Gpqa(NYU + Cohere + Anthropic (2023))

46.5

Ifbench(Google Research (2023))

30.7

Aime(MAA (Mathematical Association of America))

24.7

Tau2(Sierra + U Toronto + Vector Institute (2025))

23.1

Livecodebench(UC Berkeley + MIT + Cornell (2024))

16.9

Math Index(Artificial Analysis)

11.0

Aime 25(MAA (Mathematical Association of America))

11.0

Lcr(Artificial Analysis)

8.3

Intelligence Index(Artificial Analysis)

6.9

Terminalbench Hard(Stanford × Laude Institute (2026))

4.5

Hle(Center for AI Safety + Scale AI (2025))

4.2

LLM Stats 分类评分

(LLM Stats (zeroeval))

Math

Language

Legal

Reasoning

Finance

General

Healthcare

Chat

Roleplay

Communication

Creativity

定价

输入价格免费

输出价格免费

混合价格(3:1)免费

速度

Tokens/秒0.0

首Token延迟0.00s

首回答延迟0.00s

供应商价格排行

暂无提供商数据

外部链接

LLM Stats Artificial Analysis