Llama 3.1 Nemotron Instruct 70B

NVIDIALlama開源權重Llama 3.1 Community License

描述

A large language model customized by NVIDIA to improve the helpfulness of LLM generated responses. It is a fine-tuned version of Llama 3.1 70B Instruct. The model was trained using RLHF (REINFORCE) with HelpSteer2-Preference prompts.

發布日期

2024-10-15

參數規模

70.0B

上下文長度

128K

支援模態

text

能力雷達圖

general

coding

reasoning

science

agents

multimodal

排行榜排名

領域	#排名	分數	來源
程式碼能力榜	576	11.0	AA
通用能力榜	502	28.0	AA
科學能力	530	24.0	AA

基準測試分數 (LLM Stats)

(LLM Stats (zeroeval))

Chat

MT-Bench

0.09 / 100自報

General

MMLU

80.2%自報

Instruct HumanEval

73.8%自報

TruthfulQA

58.6%自報

Language

MMLU Chat

80.6%自報

Math

GSM8k

91.4%自報

GSM8K Chat

81.9%自報

Reasoning

HellaSwagAI2 (2019)

85.6%自報

Winogrande

84.5%自報

ARC-C

69.2%自報

Summarization

XLSum English

31.6%自報

AA 評測指數

(Artificial Analysis)

Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))

73.3

Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))

69.0

Gpqa(NYU + Cohere + Anthropic (2023))

46.5

Ifbench(Google Research (2023))

30.7

Aime(MAA (Mathematical Association of America))

24.7

Tau2(Sierra + U Toronto + Vector Institute (2025))

23.1

Livecodebench(UC Berkeley + MIT + Cornell (2024))

16.9

Math Index(Artificial Analysis)

11.0

Aime 25(MAA (Mathematical Association of America))

11.0

Lcr(Artificial Analysis)

8.3

Intelligence Index(Artificial Analysis)

6.9

Terminalbench Hard(Stanford × Laude Institute (2026))

4.5

Hle(Center for AI Safety + Scale AI (2025))

4.2

LLM Stats 分類評分

(LLM Stats (zeroeval))

Math

Language

Legal

Reasoning

Finance

General

Healthcare

Chat

Roleplay

Communication

Creativity

定價

輸入價格免費

輸出價格免費

混合價格(3:1)免費

速度

Tokens/秒0.0

首Token延遲0.00s

首回答延遲0.00s

供應商價格排行

暫無提供商資料

外部連結

LLM Stats Artificial Analysis