Llama 3.1 Instruct 405B
MetaLlamaOpen WeightLlama 3.1 Community License
Description
Llama 3.1 405B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks. The model supports 8 languages and has a 128K token context length.
Release Date
2024-07-23
Parameters
405.0B
Context Length
—
Modalities
text
Capability Radar
80
general
60
coding
90
reasoning
43
scienceest.
70
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
88.6%SR
General
BFCL
88.5%SR
MMLU
87.3%SR
Multipl-E MBPP
65.7%SR
Nexus
58.7%SR
Language
MMLU (CoT)
88.6%SR
Multipl-E HumanEval
75.2%SR
MMLU-Pro
73.3%SR
Math
GSM8k
96.8%SR
Multilingual MGSM (CoT)
91.6%SR
MATH
73.8%SR
Reasoning
ARC-C
96.9%SR
API-Bank
92.0%SR
HumanEvalOpenAI (2021)
89.0%SR
MBPP EvalPlus
88.6%SR
DROP
84.8%SR
GPQANYU + Cohere + Anthropic (2023)
50.7%SR
Gorilla Benchmark API Bench
35.3%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat90
Instruction Following90
Math90
Structured Output90
Language80
Legal80
Reasoning80
Finance80
General80
Healthcare80
Tool Calling70
Code60
Physics50
Biology50
Chemistry50
Pricing
No pricing data available
Speed
No speed data available
Provider Price Ranking
No provider data available