Saltar al contenido principal
AITier

Gemma 3 4B Instruct

GoogleGemmaOpen WeightGemma · Commercial OK

Descripción

Gemma 3 4B is a 4-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.

Fecha de lanzamiento
2025-03-12
Parámetros
4.0B
Longitud del contexto
131K
Modalidades
image, text

Radar de capacidades

17
general
6
coding
22
reasoning
17
scienceest.
0
agents
70
multimodal

Science usa un proxy de razonamiento cuando los benchmarks científicos dedicados no están disponibles.

Rankings

Dominio#PosiciónPuntuaciónFuente
Code Ranking448
6.0
AA
General Ranking467
15.0
AA
Math Reasoning291
24.0
AA
Multimodal Ranking67
65.0
LS
Reasoning96
36.0
LS
Science451
15.0
AA

Puntuaciones de benchmarks (LLM Stats)

Biology

GPQA30.8%Aut.

Code

HumanEval71.3%Aut.
LiveCodeBench12.6%Aut.

Factuality

FACTS Grounding70.1%Aut.
SimpleQA4.0%Aut.

Finance

MMLU-Pro43.6%Aut.

General

IFEval90.2%Aut.
Natural2Code70.3%Aut.
MBPP0.63 / 100Aut.
Global-MMLU-Lite54.5%Aut.
MMMU (val)48.8%Aut.
BIG-Bench Extra Hard11.0%Aut.

Image To Text

DocVQA75.8%Aut.
VQAv2 (val)62.4%Aut.
TextVQA57.8%Aut.

Language

BIG-Bench Hard72.2%Aut.
WMT24++46.8%Aut.
ECLeKTic4.6%Aut.

Math

GSM8k89.2%Aut.
MATH75.6%Aut.
MathVista-Mini50.0%Aut.
HiddenMath43.0%Aut.

Multimodal

AI2D74.8%Aut.
ChartQA68.8%Aut.
InfoVQA50.0%Aut.

Reasoning

Bird-SQL (dev)36.3%Aut.

Índices de evaluación AA

Math Index
12.7
Intelligence Index
6.3
Coding Index
2.9
Math 500
0.8
Mmlu Pro
0.4
Gpqa
0.3
Ifbench
0.3
Aime 25
0.1
Livecodebench
0.1
Scicode
0.1
Aime
0.1
Lcr
0.1
Hle
0.1
Tau2
0.1
Terminalbench Hard
0.0

Puntuaciones por categoría LLM Stats

Structured Output
90
Instruction Following
90
Grounding
70
Image To Text
70
Vision
60
Math
60
Multimodal
60
Healthcare
50
Reasoning
50
Code
40
Factuality
40
Finance
40
General
40
Language
40
Legal
40
Biology
30
Chemistry
30
Physics
30

Precios

Precio de entrada$0.04 / 1M tokens
Precio de salida$0.08 / 1M tokens
Precio mixto (3:1)$0.05 / 1M tokens

Velocidad

Tokens/seg30.0 tokens/s
Retraso del primer token1.19s
Tiempo hasta la respuesta1.19s

Proveedores disponibles

(Unidades internas LS)

No hay datos de proveedores disponibles

Fuentes externas

LLM Stats