Llama 3.1 Instruct 70B
MetaLlamaOpen WeightLlama 3.1 Community License
Description
Llama 3.1 70B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks.
Release Date
2024-07-23
Parameters
70.0B
Context Length
131K
Modalities
text
Capability Radar
70
general
60
coding
80
reasoning
34
scienceest.
70
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
87.5%SR
General
BFCL
84.8%SR
MMLU
83.6%SR
Multipl-E MBPP
62.0%SR
Nexus
56.7%SR
Language
MMLU (CoT)
86.0%SR
MMLU-Pro
66.4%SR
Multipl-E HumanEval
65.5%SR
Math
GSM-8K (CoT)
95.1%SR
Multilingual MGSM (CoT)
86.9%SR
MATH (CoT)
68.0%SR
Reasoning
ARC-C
94.8%SR
API-Bank
90.0%SR
MBPP ++ base version
86.0%SR
HumanEvalOpenAI (2021)
80.5%SR
DROP
79.6%SR
GPQANYU + Cohere + Anthropic (2023)
41.7%SR
Gorilla Benchmark API Bench
29.7%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat90
Instruction Following90
Structured Output90
Language80
Legal80
Math80
Finance80
Healthcare80
Reasoning70
General70
Tool Calling70
Code60
Physics40
Biology40
Chemistry40
Pricing
Input Price$0.56 / 1M tokens
Output Price$0.56 / 1M tokens
Blended Price (3:1)$0.4 / 1M tokens
Speed
Tokens/sec18.5
Time to First Token2.26s
Time to Answer2.26s
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: DeepInfraMost Expensive: Kilo Gateway
ProviderInputOutput
1DeepInfraCheapest
$0.4
$0.4
2MetaPRIMARY
$0.56
$0.56
3OpenRouter
$0.72
$0.72
4Kilo Gateway
$0.72
$0.72
Compare pricing across different API providers for this model.