Skip to main content
AITier

Gemma 3 4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3 4B is a 4-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Release Date
2025-03-12
Parameters
4.0B
Context Length
131K
Modalities
image, text

Capability Radar

14
general
10
coding
22
reasoning
17
scienceest.
18
agents
70
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking464
7.0
AA
General Ranking489
14.0
AA
Math Reasoning290
24.0
AA
Multimodal Ranking76
65.0
LS
Reasoning101
36.0
LS
Science479
14.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA30.8%SR

Code

HumanEval71.3%SR
LiveCodeBench12.6%SR

Factuality

FACTS Grounding70.1%SR
SimpleQA4.0%SR

Finance

MMLU-Pro43.6%SR

General

IFEval90.2%SR
Natural2Code70.3%SR
MBPP0.63 / 100SR
Global-MMLU-Lite54.5%SR
MMMU (val)48.8%SR
BIG-Bench Extra Hard11.0%SR

Image To Text

DocVQA75.8%SR
VQAv2 (val)62.4%SR
TextVQA57.8%SR

Language

BIG-Bench Hard72.2%SR
WMT24++46.8%SR
ECLeKTic4.6%SR

Math

GSM8k89.2%SR
MATH75.6%SR
MathVista-Mini50.0%SR
HiddenMath43.0%SR

Multimodal

AI2D74.8%SR
ChartQA68.8%SR
InfoVQA50.0%SR

Reasoning

Bird-SQL (dev)36.3%SR

AA Evaluation Indices

Math Index
12.7
Intelligence Index
1.1
Math 500
0.8
Mmlu Pro
0.4
Gpqa
0.3
Ifbench
0.3
Aime 25
0.1
Livecodebench
0.1
Scicode
0.1
Aime
0.1
Lcr
0.1
Hle
0.1
Tau2
0.0
Terminalbench Hard
0.0

LLM Stats Category Scores

Instruction Following
90
Structured Output
90
Image To Text
70
Grounding
70
Math
60
Multimodal
60
Vision
60
Reasoning
50
Healthcare
50
Language
40
Legal
40
Factuality
40
Finance
40
General
40
Code
40
Physics
30
Biology
30
Chemistry
30

Pricing

Input Price$0.04 / 1M tokens
Output Price$0.08 / 1M tokens
Blended Price (3:1)$0.05 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

6 providers

Cheapest: ChutesMost Expensive: NanoGPT
ProviderInputOutput
1ChutesCheapest
$0.01
$0.0272
2GooglePRIMARY
$0.04
$0.08
3Kilo Gateway
$0.04
$0.08
4Amazon Bedrock
$0.04
$0.08
5OpenRouter
$0.05
$0.1
6NanoGPT
$0.2006
$0.2006

Compare pricing across different API providers for this model.

External Sources

LLM StatsArtificial Analysis