Skip to main content

Gemma 3n E4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3n is a generative AI model optimized for use in everyday devices, such as phones, laptops, and tablets. It features innovations like Per-Layer Embedding (PLE) parameter caching and a MatFormer model architecture for reduced compute and memory. These models handle audio, text, and visual data, though this E4B preview currently supports text and vision input. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models, and is licensed for responsible commercial use.

Release Date
2025-06-26
Parameters
1.9B
Context Length
33K
Modalities
image, text

Capability Radar

16
general
8
coding
25
reasoning
17
science
20
agents
80
multimodal

Rankings

Domain#RankScoreSource
Code Ranking534
5.0
AA
General Ranking540
16.0
AA
Science544
14.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)23.7%SR

Chemistry

OpenAI MMLU35.6%SR

Code

HumanEvalOpenAI (2021)75.0%SR
Codegolf v2.216.8%SR
LiveCodeBench13.2%SR

Creativity

Social IQa50.0%SR

Finance

MMLU64.9%SR
MMLU-Pro50.6%SR
MMLU-ProX19.9%SR

General

ARC-E81.6%SR
PIQA81.0%SR
TriviaQA70.2%SR
Global-MMLU-Lite64.5%SR
MBPP0.64 / 100SR
ARC-C61.6%SR
Global-MMLU60.3%SR
Include57.2%SR
LiveCodeBench v525.7%SR
Natural Questions20.9%SR

Language

BoolQ81.6%SR
Winogrande71.7%SR
BIG-Bench Hard52.9%SR
WMT24++50.1%SR
ECLeKTic1.9%SR

Math

DROP60.8%SR
MGSM60.7%SR
HiddenMath37.7%SR
AIME 202511.6%SR

Reasoning

HellaSwagAI2 (2019)78.6%SR

AA Evaluation Indices

(Artificial Analysis)
Math Index(Artificial Analysis)
14.3
Coding Index(Artificial Analysis)
3.2
Intelligence Index(Artificial Analysis)
1.0
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.8
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.5
Gpqa(NYU + Cohere + Anthropic (2023))
0.3
Ifbench(Google Research (2023))
0.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.1
Aime 25(MAA (Mathematical Association of America))
0.1
Aime(MAA (Mathematical Association of America))
0.1
Scicode(UIUC + Argonne National Lab (2024))
0.1
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.0
Hle(Center for AI Safety + Scale AI (2025))
0.0
Terminalbench Hard(Stanford × Laude Institute (2026))
0.0
Terminalbench V2 1
0.0
Tau Banking
0.0
Lcr(Artificial Analysis)
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Legal
50
Physics
50
Psychology
50
Reasoning
50
Language
50
Finance
50
General
50
Healthcare
50
Creativity
50
Math
40
Code
40
Search
20
Biology
20
Chemistry
20

Pricing

Input Price$0.06 / 1M tokens
Output Price$0.12 / 1M tokens
Blended Price (3:1)$0.075 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

3 providers

Cheapest: GoogleMost Expensive: Kilo Gateway
ProviderInputOutput
1GooglePRIMARY
$0.06
$0.12
2OpenRouter
$0.06
$0.12
3Kilo Gateway
$0.06
$0.12

Compare pricing across different API providers for this model.

External Sources