Skip to main content

Gemma 3n E4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3n is a generative AI model optimized for use in everyday devices, such as phones, laptops, and tablets. It features innovations like Per-Layer Embedding (PLE) parameter caching and a MatFormer model architecture for reduced compute and memory. These models handle audio, text, and visual data, though this E4B preview currently supports text and vision input. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models, and is licensed for responsible commercial use.

Release Date
2025-06-26
Parameters
1.9B
Context Length
33K
Modalities
image, text

Capability Radar

16
general
13
coding
25
reasoning
17
scienceest.
21
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking465
7.0
AA
General Ranking476
16.0
AA
Math Reasoning284
26.0
AA
Reasoning35
79.0
LS
Science480
14.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA23.7%SR

Code

HumanEval75.0%SR
Codegolf v2.216.8%SR
LiveCodeBench13.2%SR

Creativity

Social IQa50.0%SR

Finance

MMLU64.9%SR
MMLU-Pro50.6%SR
MMLU-ProX19.9%SR

General

ARC-E81.6%SR
PIQA81.0%SR
TriviaQA70.2%SR
Global-MMLU-Lite64.5%SR
MBPP0.64 / 100SR
ARC-C61.6%SR
Global-MMLU60.3%SR
Include57.2%SR
LiveCodeBench v525.7%SR
Natural Questions20.9%SR

Language

BoolQ81.6%SR
Winogrande71.7%SR
BIG-Bench Hard52.9%SR
WMT24++50.1%SR
ECLeKTic1.9%SR

Math

DROP60.8%SR
MGSM60.7%SR
HiddenMath37.7%SR
AIME 202511.6%SR

Reasoning

HellaSwag78.6%SR

AA Evaluation Indices

Math Index
14.3
Intelligence Index
1.2
Math 500
0.8
Mmlu Pro
0.5
Gpqa
0.3
Ifbench
0.3
Livecodebench
0.1
Aime 25
0.1
Aime
0.1
Scicode
0.1
Tau2
0.0
Hle
0.0
Terminalbench Hard
0.0
Lcr
0.0

LLM Stats Category Scores

Language
50
Legal
50
Physics
50
Psychology
50
Reasoning
50
Finance
50
General
50
Healthcare
50
Creativity
50
Math
40
Code
40
Search
20
Biology
20
Chemistry
20

Pricing

Input Price$0.02 / 1M tokens
Output Price$0.04 / 1M tokens
Blended Price (3:1)$0.025 / 1M tokens

Speed

Tokens/sec53.6
Time to First Token0.52s
Time to Answer0.52s

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: GoogleMost Expensive: Together AI
ProviderInputOutput
1GooglePRIMARY
$0.02
$0.04
2Together AI
$0.06
$0.12

Compare pricing across different API providers for this model.

External Sources