Saltar al contenido principal
AITier

Gemini 1.5 Pro (Sep '24)

GoogleGeminiProprietary

Descripción

Gemini 1.5 Pro is a mid-size multimodal model optimized for a wide range of reasoning tasks. It can process large amounts of data at once, including 2 hours of video, 19 hours of audio, codebases with 60,000 lines of code, or 2,000 pages of text.

Fecha de lanzamiento
2024-09-24
Parámetros
—
Longitud del contexto
—
Modalidades
image, text

Radar de capacidades

28
general
27
coding
50
reasoning
42
science
43
agents
80
multimodal

Rankings

Dominio#PosiciónPuntuaciónFuente
Ranking de codificación422
31.0
AA
Ranking general421
33.0
AA
Ranking multimodal91
48.0
LS
Ciencia449
32.0
AA

Puntuaciones de benchmarks (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU85.9%Aut.

Language

FLEURS93.3%Aut.
MMLU-Pro75.8%Aut.
WMT2375.1%Aut.

Long Context

MRCR82.6%Aut.

Math

GSM8k90.8%Aut.
MGSM87.5%Aut.
MATH86.5%Aut.
MathVista68.1%Aut.
FunctionalMATH64.6%Aut.
HiddenMath52.0%Aut.
AMC_2022_2346.4%Aut.

Multimodal

Video-MME78.6%Aut.
MMMU65.9%Aut.
Vibe-Eval53.9%Aut.

Physics

PhysicsFinals63.9%Aut.

Reasoning

HellaSwagAI2 (2019)93.3%Aut.
BIG-Bench Hard89.2%Aut.
Natural2Code85.4%Aut.
HumanEvalOpenAI (2021)84.1%Aut.
DROP74.9%Aut.
GPQANYU + Cohere + Anthropic (2023)59.1%Aut.

Safety

XSTest98.8%Aut.

Índices de evaluación AA

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
87.6
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
75.0
Gpqa(NYU + Cohere + Anthropic (2023))
58.9
Livecodebench(UC Berkeley + MIT + Cornell (2024))
31.6
Coding Index(Artificial Analysis)
23.6
Aime(MAA (Mathematical Association of America))
23.0
Intelligence Index(Artificial Analysis)
7.9
Hle(Center for AI Safety + Scale AI (2025))
4.6

Puntuaciones por categoría LLM Stats

(LLM Stats (zeroeval))
Safety
100
Speech To Text
90
Language
80
Legal
80
Long Context
80
Math
80
Reasoning
80
Finance
80
General
80
Healthcare
80
Code
80
Multimodal
70
Vision
70
Physics
60
Biology
60
Chemistry
60

Precios

Precio de entradaGratis
Precio de salidaGratis
Precio mixto (3:1)Gratis

Velocidad

Tokens/seg0.0
Retraso del primer token0.00s
Tiempo hasta la respuesta0.00s

Ranking de Precios por Proveedor

No hay datos de proveedores disponibles

Fuentes externas

LLM StatsArtificial Analysis