Skip to main content

Gemma 3 4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3 4B is a 4-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Release Date
2025-03-12
Parameters
4.0B
Context Length
131K
Modalities
image, text

Capability Radar

50
general
40
coding
60
reasoning
26
scienceest.
54
agents
70
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

Domain#RankScoreSource
Multimodal Ranking129
31.0
LS

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)90.2%SR

Factuality

SimpleQA4.0%SR

General

Global-MMLU-Lite54.5%SR

Language

WMT24++46.8%SR
MMLU-Pro43.6%SR
ECLeKTic4.6%SR

Math

GSM8k89.2%SR
MATH75.6%SR
MathVista-Mini50.0%SR
HiddenMath43.0%SR

Reasoning

BIG-Bench Hard72.2%SR
HumanEvalOpenAI (2021)71.3%SR
Natural2Code70.3%SR
FACTS Grounding70.1%SR
ChartQAMasry et al. (2022)68.8%SR
MBPP0.63 / 100SR
Bird-SQL (dev)36.3%SR
GPQANYU + Cohere + Anthropic (2023)30.8%SR
LiveCodeBench12.6%SR
BIG-Bench Extra Hard11.0%SR

Vision

DocVQADocVQA (2020)75.8%SR
AI2D74.8%SR
VQAv2 (val)62.4%SR
TextVQA57.8%SR
InfoVQA50.0%SR
MMMU (val)48.8%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Chat
90
Instruction Following
90
Structured Output
90
Image To Text
70
Grounding
70
Math
60
Multimodal
60
Vision
60
Reasoning
50
General
50
Healthcare
50
Language
40
Legal
40
Factuality
40
Finance
40
Code
40
Physics
30
Biology
30
Chemistry
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)$0.0625 / 1M tokens

Speed

No speed data available

Provider Price Ranking

Provider Price Ranking

7 providers

Cheapest: Kilo GatewayMost Expensive: AI/ML API
ProviderInputOutput
1Kilo GatewayCheapest
$0.04
$0.05
2Merge Gateway
$0.04
$0.08
3DeepInfra
$0.05
$0.1
4OpenRouter
$0.05
$0.1
5Hugging Face
$0.05
$0.1
6Deep Infra
$0.05
$0.1
7AI/ML API
$0.0529
$0.1058

Compare pricing across different API providers for this model.

External Sources