Passer au contenu principal

Gemma 3n E4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 3n is a generative AI model optimized for use in everyday devices, such as phones, laptops, and tablets. It features innovations like Per-Layer Embedding (PLE) parameter caching and a MatFormer model architecture for reduced compute and memory. These models handle audio, text, and visual data, though this E4B preview currently supports text and vision input. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models, and is licensed for responsible commercial use.

Date de sortie
2025-06-26
Paramètres
1.9B
Longueur du contexte
33K
Modalités
image, text

Radar de capacités

19
general
8
coding
25
reasoning
17
scienceest.
0
agents
80
multimodal

Science utilise un proxy de raisonnement lorsque les benchmarks scientifiques dédiés ne sont pas disponibles.

Classements

Domaine#RangScoreSource
Code Ranking443
7.0
AA
General Ranking454
17.0
AA
Math Reasoning284
26.0
AA
Reasoning33
79.0
LS
Science453
15.0
AA

Scores de benchmarks (LLM Stats)

Biology

GPQA23.7%Aut.

Code

HumanEval75.0%Aut.
Codegolf v2.216.8%Aut.
LiveCodeBench13.2%Aut.

Creativity

Social IQa50.0%Aut.

Finance

MMLU64.9%Aut.
MMLU-Pro50.6%Aut.
MMLU-ProX19.9%Aut.

General

ARC-E81.6%Aut.
PIQA81.0%Aut.
TriviaQA70.2%Aut.
Global-MMLU-Lite64.5%Aut.
MBPP0.64 / 100Aut.
ARC-C61.6%Aut.
Global-MMLU60.3%Aut.
Include57.2%Aut.
LiveCodeBench v525.7%Aut.
Natural Questions20.9%Aut.

Language

BoolQ81.6%Aut.
Winogrande71.7%Aut.
BIG-Bench Hard52.9%Aut.
WMT24++50.1%Aut.
ECLeKTic1.9%Aut.

Math

DROP60.8%Aut.
MGSM60.7%Aut.
HiddenMath37.7%Aut.
AIME 202511.6%Aut.

Reasoning

HellaSwag78.6%Aut.

Indices d'évaluation AA

Math Index
14.3
Intelligence Index
6.4
Coding Index
4.2
Math 500
0.8
Mmlu Pro
0.5
Gpqa
0.3
Ifbench
0.3
Livecodebench
0.1
Aime 25
0.1
Aime
0.1
Scicode
0.1
Tau2
0.1
Hle
0.0
Terminalbench Hard
0.0
Lcr
0.0

Scores par catégorie LLM Stats

Creativity
50
Finance
50
General
50
Healthcare
50
Language
50
Legal
50
Physics
50
Psychology
50
Reasoning
50
Code
40
Math
40
Biology
20
Chemistry
20
Search
20

Tarification

Prix d'entrée$0.02 / 1M tokens
Prix de sortie$0.04 / 1M tokens
Prix mixte (3:1)$0.025 / 1M tokens

Vitesse

Tokens/sec21.2 tokens/s
Délai du premier token0.64s
Temps de réponse0.64s

Fournisseurs disponibles

(Unités internes LS)

Aucune donnée de fournisseur disponible

Sources externes