Saltar al contenido principal

Gemma 3 27B Instruct

GoogleGemmaOpen WeightGemma · Uso Comercial

Descripción

Gemma 3 27B is a 27-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for complex question answering, summarization, reasoning, and image understanding tasks.

Fecha de lanzamiento
2025-03-12
Parámetros
27.0B
Longitud del contexto
262K
Modalidades
image, text

Radar de capacidades

25
general
12
coding
34
reasoning
28
science
27
agents
70
multimodal

Rankings

Dominio#PosiciónPuntuaciónFuente
Ranking de codificación495
11.0
AA
Ranking general464
26.0
AA
Ranking multimodal54
44.0
LS
Ciencia461
27.0
AA

Puntuaciones de benchmarks (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)42.4%Aut.

Code

HumanEvalOpenAI (2021)87.8%Aut.
LiveCodeBench29.7%Aut.

Factuality

FACTS Grounding74.9%Aut.
SimpleQA10.0%Aut.

Finance

MMLU-Pro67.5%Aut.

General

IFEvalGoogle Research (2023)90.4%Aut.
Natural2Code84.5%Aut.
Global-MMLU-Lite75.1%Aut.
MBPP0.74 / 100Aut.
MMMU (val)64.9%Aut.
BIG-Bench Extra Hard19.3%Aut.
MRCR v2 (8-needle)13.5%Aut.

Image To Text

DocVQADocVQA (2020)86.6%Aut.
VQAv2 (val)71.0%Aut.
TextVQA65.1%Aut.

Language

BIG-Bench Hard87.6%Aut.
WMT24++53.4%Aut.
ECLeKTic16.7%Aut.

Math

GSM8k95.9%Aut.
MATH89.0%Aut.
MathVista-Mini67.6%Aut.
HiddenMath60.3%Aut.

Multimodal

AI2D84.5%Aut.
ChartQAMasry et al. (2022)78.0%Aut.
InfoVQA70.6%Aut.

Reasoning

Bird-SQL (dev)54.4%Aut.

Índices de evaluación AA

(Artificial Analysis)
Math Index(Artificial Analysis)
20.7
Coding Index(Artificial Analysis)
10.1
Intelligence Index(Artificial Analysis)
7.4
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.9
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.7
Gpqa(NYU + Cohere + Anthropic (2023))
0.4
Ifbench(Google Research (2023))
0.3
Aime(MAA (Mathematical Association of America))
0.3
Scicode(UIUC + Argonne National Lab (2024))
0.2
Aime 25(MAA (Mathematical Association of America))
0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.1
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.1
Lcr(Artificial Analysis)
0.1
Terminalbench V2 1
0.0
Hle(Center for AI Safety + Scale AI (2025))
0.0
Terminalbench Hard(Stanford × Laude Institute (2026))
0.0
Tau Banking
0.0

Puntuaciones por categoría LLM Stats

(LLM Stats (zeroeval))
Structured Output
90
Instruction Following
90
Math
80
Legal
70
Multimodal
70
Image To Text
70
Finance
70
Grounding
70
Healthcare
70
Vision
70
Reasoning
60
Language
60
General
60
Code
60
Physics
40
Factuality
40
Biology
40
Chemistry
40
Long Context
10

Precios

Precio de entradaGratis
Precio de salidaGratis
Precio mixto (3:1)Gratis
Precio de lectura caché$0.04 / 1M tokens

Velocidad

Tokens/seg0.0
Retraso del primer token0.00s
Tiempo hasta la respuesta0.00s

Ranking de Precios por Proveedor

Ranking de Precios por Proveedor

6 proveedores

Más barato: OpenRouterMás caro: STACKIT
ProveedorEntradaSalida
1OpenRouterMás barato
$0.08
$0.45
2Kilo Gateway
$0.08
$0.16
3Nebius Token Factory
$0.1
$0.3
4LLM Gateway
$0.1
$0.3
5NovitaAI
$0.119
$0.2
6STACKIT
$0.53
$0.76

Comparar precios entre diferentes proveedores de API para este modelo.

Fuentes externas