Skip to main content

Gemma 3n E4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3n is a generative AI model optimized for use in everyday devices, such as phones, laptops, and tablets. It features innovations like Per-Layer Embedding (PLE) parameter caching and a MatFormer model architecture for reduced compute and memory. These models handle audio, text, and visual data, though this E4B preview currently supports text and vision input. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models, and is licensed for responsible commercial use.

Release Date
2025-06-26
Parameters
1.9B
Context Length
33K
Modalities
image, text

Capability Radar

19
general
8
coding
25
reasoning
17
scienceest.
0
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking443
7.0
AA
General Ranking454
17.0
AA
Math Reasoning284
26.0
AA
Reasoning33
79.0
LS
Science453
15.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA23.7%SR

Code

HumanEval75.0%SR
Codegolf v2.216.8%SR
LiveCodeBench13.2%SR

Creativity

Social IQa50.0%SR

Finance

MMLU64.9%SR
MMLU-Pro50.6%SR
MMLU-ProX19.9%SR

General

ARC-E81.6%SR
PIQA81.0%SR
TriviaQA70.2%SR
Global-MMLU-Lite64.5%SR
MBPP0.64 / 100SR
ARC-C61.6%SR
Global-MMLU60.3%SR
Include57.2%SR
LiveCodeBench v525.7%SR
Natural Questions20.9%SR

Language

BoolQ81.6%SR
Winogrande71.7%SR
BIG-Bench Hard52.9%SR
WMT24++50.1%SR
ECLeKTic1.9%SR

Math

DROP60.8%SR
MGSM60.7%SR
HiddenMath37.7%SR
AIME 202511.6%SR

Reasoning

HellaSwag78.6%SR

AA Evaluation Indices

Math Index
14.3
Intelligence Index
6.4
Coding Index
4.2
Math 500
0.8
Mmlu Pro
0.5
Gpqa
0.3
Ifbench
0.3
Livecodebench
0.1
Aime 25
0.1
Aime
0.1
Scicode
0.1
Tau2
0.1
Hle
0.0
Terminalbench Hard
0.0
Lcr
0.0

LLM Stats Category Scores

Creativity
50
Finance
50
General
50
Healthcare
50
Language
50
Legal
50
Physics
50
Psychology
50
Reasoning
50
Code
40
Math
40
Biology
20
Chemistry
20
Search
20

Pricing

Input Price$0.02 / 1M tokens
Output Price$0.04 / 1M tokens
Blended Price (3:1)$0.025 / 1M tokens

Speed

Tokens/sec21.2 tokens/s
Time to First Token0.64s
Time to Answer0.64s

Available Providers

(LS internal units)

No provider data available

External Sources