Skip to main content

Llama 3.2 Instruct 3B

MetaLlamaOpen WeightLlama 3.2 Community License

Description

Llama 3.2 3B Instruct is a large language model that supports a context length of 128K tokens and are state-of-the-art in their class for on-device use cases like summarization, instruction following, and rewriting tasks running locally at the edge.

Release Date
2024-09-25
Parameters
3.2B
Context Length
131K
Modalities
text

Capability Radar

13
general
8
coding
13
reasoning
14
science
50
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking519
6.0
AA
General Ranking519
17.0
AA
Science543
12.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)32.8%SR

Finance

MMLU63.4%SR

General

ARC-C78.6%SR
IFEvalGoogle Research (2023)77.4%SR
BFCL v267.0%SR
Nexus34.3%SR

Language

Open-rewrite40.1%SR
TLDR9+ (test)19.0%SR

Long Context

NIH/Multi-needle84.7%SR
InfiniteBench/En.MC63.3%SR
InfiniteBench/En.QA19.8%SR

Math

GSM8k77.7%SR
MGSM58.2%SR
MATH48.0%SR

Reasoning

HellaSwagAI2 (2019)69.8%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
3.9
Math Index(Artificial Analysis)
3.3
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.5
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.3
Ifbench(Google Research (2023))
0.3
Gpqa(NYU + Cohere + Anthropic (2023))
0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.1
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.1
Scicode(UIUC + Argonne National Lab (2024))
0.1
Aime 25(MAA (Mathematical Association of America))
0.0
Lcr(Artificial Analysis)
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Instruction Following
80
Structured Output
80
Language
60
Legal
60
Math
60
Reasoning
60
Finance
60
General
60
Healthcare
60
Tool Calling
50
Physics
30
Biology
30
Chemistry
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

4 providers

Cheapest: NovitaAIMost Expensive: Kilo Gateway
ProviderInputOutput
1NovitaAICheapest
$0.03
$0.05
2NanoGPT
$0.0306
$0.0493
3OpenRouter
$0.05
$0.33
4Kilo Gateway
$0.05
$0.33

Compare pricing across different API providers for this model.

External Sources