Gemma 3 4B Instruct
GoogleGemmaOpen WeightGemma · Commercial OK
Description
Gemma 3 4B is a 4-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.
Release Date
2025-03-12
Parameters
4.0B
Context Length
131K
Modalities
image, text
Capability Radar
50
general
40
coding
60
reasoning
26
scienceest.
54
agents
70
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Multimodal Ranking | 129 | 31.0 | LS |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
90.2%SR
Factuality
SimpleQA
4.0%SR
General
Global-MMLU-Lite
54.5%SR
Language
WMT24++
46.8%SR
MMLU-Pro
43.6%SR
ECLeKTic
4.6%SR
Math
GSM8k
89.2%SR
MATH
75.6%SR
MathVista-Mini
50.0%SR
HiddenMath
43.0%SR
Reasoning
BIG-Bench Hard
72.2%SR
HumanEvalOpenAI (2021)
71.3%SR
Natural2Code
70.3%SR
FACTS Grounding
70.1%SR
ChartQAMasry et al. (2022)
68.8%SR
MBPP
0.63 / 100SR
Bird-SQL (dev)
36.3%SR
GPQANYU + Cohere + Anthropic (2023)
30.8%SR
LiveCodeBench
12.6%SR
BIG-Bench Extra Hard
11.0%SR
Vision
DocVQADocVQA (2020)
75.8%SR
AI2D
74.8%SR
VQAv2 (val)
62.4%SR
TextVQA
57.8%SR
InfoVQA
50.0%SR
MMMU (val)
48.8%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat90
Instruction Following90
Structured Output90
Image To Text70
Grounding70
Math60
Multimodal60
Vision60
Reasoning50
General50
Healthcare50
Language40
Legal40
Factuality40
Finance40
Code40
Physics30
Biology30
Chemistry30
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)$0.0625 / 1M tokens
Speed
No speed data available
Provider Price Ranking
Provider Price Ranking
7 providers
Cheapest: Kilo GatewayMost Expensive: AI/ML API
ProviderInputOutput
1Kilo GatewayCheapest
$0.04
$0.05
2Merge Gateway
$0.04
$0.08
3DeepInfra
$0.05
$0.1
4OpenRouter
$0.05
$0.1
5Hugging Face
$0.05
$0.1
6Deep Infra
$0.05
$0.1
7AI/ML API
$0.0529
$0.1058
Compare pricing across different API providers for this model.