Skip to main content

Gemma 3 12B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Release Date
2025-03-12
Parameters
12.0B
Context Length
131K
Modalities
image, text

Capability Radar

60
general
60
coding
70
reasoning
34
scienceest.
67
agents
80
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

Domain#RankScoreSource
Multimodal Ranking107
40.0
LS

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)88.9%SR

Factuality

SimpleQA6.3%SR

General

Global-MMLU-Lite69.5%SR

Language

MMLU-Pro60.6%SR
WMT24++51.6%SR
ECLeKTic10.3%SR

Math

GSM8k94.4%SR
MATH83.8%SR
MathVista-Mini62.9%SR
HiddenMath54.5%SR

Reasoning

BIG-Bench Hard85.7%SR
HumanEvalOpenAI (2021)85.4%SR
Natural2Code80.7%SR
FACTS Grounding75.8%SR
ChartQAMasry et al. (2022)75.7%SR
MBPP0.73 / 100SR
Bird-SQL (dev)47.9%SR
GPQANYU + Cohere + Anthropic (2023)40.9%SR
LiveCodeBench24.6%SR
BIG-Bench Extra Hard16.3%SR

Vision

DocVQADocVQA (2020)87.1%SR
AI2D84.2%SR
VQAv2 (val)71.6%SR
TextVQA67.7%SR
InfoVQA64.9%SR
MMMU (val)59.6%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Chat
90
Instruction Following
90
Structured Output
90
Image To Text
80
Grounding
80
Math
70
Multimodal
70
Vision
70
Legal
60
Reasoning
60
Finance
60
General
60
Healthcare
60
Code
60
Language
50
Physics
40
Factuality
40
Biology
40
Chemistry
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)$0.075 / 1M tokens

Speed

No speed data available

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: DeepInfraMost Expensive: Neon
ProviderInputOutput
1DeepInfraCheapest
$0.05
$0.15
2Neon
$0.15
$0.5

Compare pricing across different API providers for this model.

External Sources