Skip to main content
AITier

Llama 3.2 Instruct 11B (Vision)

MetaLlamaOpen WeightLlama 3.2 Community License

Description

Llama 3.2 11B Vision Instruct is an instruction-tuned multimodal large language model optimized for visual recognition, image reasoning, captioning, and answering general questions about an image. It accepts text and images as input and generates text as output.

Release Date
2024-09-25
Parameters
10.6B
Context Length
131K
Modalities
image, text

Capability Radar

19
general
7
coding
13
reasoning
15
scienceest.
0
agents
90
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking432
8.0
AA
General Ranking428
21.0
AA
Math Reasoning328
13.0
AA
Multimodal Ranking23
84.0
LS
Science455
14.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA32.8%SR

Finance

MMLU73.0%SR

General

MMMU50.7%SR
MMMU-Pro33.0%SR

Image To Text

DocVQA88.4%SR
VQAv2 (test)75.2%SR

Math

MGSM68.9%SR
MATH51.9%SR
MathVista51.5%SR

Multimodal

AI2D91.1%SR
ChartQA83.4%SR

AA Evaluation Indices

Intelligence Index
8.7
Coding Index
4.3
Math Index
1.7
Math 500
0.5
Mmlu Pro
0.5
Ifbench
0.3
Gpqa
0.2
Tau2
0.1
Lcr
0.1
Scicode
0.1
Livecodebench
0.1
Aime
0.1
Hle
0.1
Aime 25
0.0
Terminalbench Hard
0.0

LLM Stats Category Scores

Image To Text
90
Vision
70
Finance
70
Language
70
Legal
70
Multimodal
70
Healthcare
60
Math
60
Reasoning
60
General
50
Biology
30
Chemistry
30
Physics
30

Pricing

Input Price$0.245 / 1M tokens
Output Price$0.245 / 1M tokens
Blended Price (3:1)$0.245 / 1M tokens

Speed

Tokens/sec86.7 tokens/s
Time to First Token0.52s
Time to Answer0.52s

Available Providers

(LS internal units)

No provider data available

External Sources

LLM Stats