Llama 3 Instruct 8B
MetaLlama
Release Date
2024-04-18
Parameters
—
Context Length
131K
Modalities
text
Capability Radar
14
general
10
coding
21
reasoning
19
scienceest.
80
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 483 | 3.0 | AA |
| General Ranking | 498 | 12.0 | AA |
| Math Reasoning | 292 | 24.0 | AA |
| Science | 455 | 17.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
50.5%SR
Code
HumanEval
88.4%SR
Finance
MMLU
86.0%SR
MMLU-Pro
68.9%SR
General
IFEval
92.1%SR
MBPP EvalPlus
87.6%SR
BFCL v2
77.3%SR
Math
MGSM
91.1%SR
MATH
77.0%SR
AA Evaluation Indices
Intelligence Index1.2
Math 5000.5
Mmlu Pro0.4
Gpqa0.3
Ifbench0.2
Scicode0.1
Livecodebench0.1
Hle0.1
Aime0.0
Lcr0.0
Terminalbench Hard0.0
Tau20.0
LLM Stats Category Scores
Instruction Following90
Structured Output90
Code90
Language80
Legal80
Math80
Reasoning80
Finance80
Healthcare80
Tool Calling80
General70
Physics50
Biology50
Chemistry50
Pricing
Input Price$0.045 / 1M tokens
Output Price$0.145 / 1M tokens
Blended Price (3:1)$0.07 / 1M tokens
Speed
Tokens/sec83.7
Time to First Token0.48s
Time to Answer0.48s
Provider Price Ranking
Provider Price Ranking
11 providers
Cheapest: Kilo GatewayMost Expensive: Azure
ProviderInputOutput
1Kilo GatewayCheapest
$0.03
$0.04
2NovitaAI
$0.04
$0.04
3MetaPRIMARY
$0.045
$0.145
4Cloudflare AI Gateway
$0.12
$0.27
5OpenRouter
$0.14
$0.14
6Helicone
$0.14
$0.14
7LLM Gateway
$0.14
$0.14
8Together AI
$0.14
$0.14
9DigitalOcean
$0.198
$0.198
10Azure Cognitive Services
$0.3
$0.61
11Azure
$0.3
$0.61
Compare pricing across different API providers for this model.