Skip to main content

Llama 3.2 Instruct 3B

MetaLlamaOpen WeightLlama 3.2 Community License

Description

Llama 3.2 3B Instruct is a large language model that supports a context length of 128K tokens and are state-of-the-art in their class for on-device use cases like summarization, instruction following, and rewriting tasks running locally at the edge.

Release Date
2024-09-25
Parameters
3.2B
Context Length
131K
Modalities
text

Capability Radar

14
general
8
coding
13
reasoning
19
science
50
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking599
7.0
AA
General Ranking601
17.0
AA
Science630
13.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)77.4%SR

General

BFCL v267.0%SR
MMLU63.4%SR
Nexus34.3%SR

Language

Open-rewrite40.1%SR

Long Context

NIH/Multi-needle84.7%SR
InfiniteBench/En.MC63.3%SR
InfiniteBench/En.QA19.8%SR

Math

GSM8k77.7%SR
MGSM58.2%SR
MATH48.0%SR

Reasoning

ARC-C78.6%SR
HellaSwagAI2 (2019)69.8%SR
GPQANYU + Cohere + Anthropic (2023)32.8%SR

Summarization

TLDR9+ (test)19.0%SR

AA Evaluation Indices

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
48.9
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
34.7
Ifbench(Google Research (2023))
26.2
Gpqa(NYU + Cohere + Anthropic (2023))
25.5
Tau2(Sierra + U Toronto + Vector Institute (2025))
21.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))
8.3
Aime(MAA (Mathematical Association of America))
6.7
Intelligence Index(Artificial Analysis)
5.7
Hle(Center for AI Safety + Scale AI (2025))
5.3
Lcr(Artificial Analysis)
4.3
Aime 25(MAA (Mathematical Association of America))
3.3
Math Index(Artificial Analysis)
3.3

LLM Stats Category Scores

(LLM Stats (zeroeval))
Chat
80
Instruction Following
80
Structured Output
80
Language
60
Legal
60
Math
60
Reasoning
60
Finance
60
General
60
Healthcare
60
Tool Calling
50
Physics
30
Biology
30
Chemistry
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

4 providers

Cheapest: NovitaAIMost Expensive: Kilo Gateway
ProviderInputOutput
1NovitaAICheapest
$0.03
$0.05
2NanoGPT
$0.0306
$0.0493
3OpenRouter
$0.05
$0.33
4Kilo Gateway
$0.05
$0.33

Compare pricing across different API providers for this model.

External Sources