Skip to main content

Llama 3.1 Instruct 70B

MetaLlamaOpen WeightLlama 3.1 Community License

Description

Llama 3.1 70B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks.

Release Date
2024-07-23
Parameters
70.0B
Context Length
131K
Modalities
text

Capability Radar

70
general
60
coding
80
reasoning
34
scienceest.
70
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)87.5%SR

General

BFCL84.8%SR
MMLU83.6%SR
Multipl-E MBPP62.0%SR
Nexus56.7%SR

Language

MMLU (CoT)86.0%SR
MMLU-Pro66.4%SR
Multipl-E HumanEval65.5%SR

Math

GSM-8K (CoT)95.1%SR
Multilingual MGSM (CoT)86.9%SR
MATH (CoT)68.0%SR

Reasoning

ARC-C94.8%SR
API-Bank90.0%SR
MBPP ++ base version86.0%SR
HumanEvalOpenAI (2021)80.5%SR
DROP79.6%SR
GPQANYU + Cohere + Anthropic (2023)41.7%SR
Gorilla Benchmark API Bench29.7%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Chat
90
Instruction Following
90
Structured Output
90
Language
80
Legal
80
Math
80
Finance
80
Healthcare
80
Reasoning
70
General
70
Tool Calling
70
Code
60
Physics
40
Biology
40
Chemistry
40

Pricing

Input Price$0.56 / 1M tokens
Output Price$0.56 / 1M tokens
Blended Price (3:1)$0.4 / 1M tokens

Speed

Tokens/sec18.5
Time to First Token2.26s
Time to Answer2.26s

Provider Price Ranking

Provider Price Ranking

4 providers

Cheapest: DeepInfraMost Expensive: Kilo Gateway
ProviderInputOutput
1DeepInfraCheapest
$0.4
$0.4
2MetaPRIMARY
$0.56
$0.56
3OpenRouter
$0.72
$0.72
4Kilo Gateway
$0.72
$0.72

Compare pricing across different API providers for this model.

External Sources