Gemini 1.5 Pro (May '24)
GoogleGemini
Release Date
2024-05-15
Parameters
—
Context Length
—
Modalities
—
Capability Radar
24
general
22
coding
32
reasoning
27
science
29
agents
80
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 382 | 25.0 | AA |
| General Ranking | 445 | 29.0 | AA |
| Science | 462 | 27.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))No benchmark data available
AA Evaluation Indices
(Artificial Analysis)Coding Index(Artificial Analysis)19.8
Intelligence Index(Artificial Analysis)6.1
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.4
Scicode(UIUC + Argonne National Lab (2024))0.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.2
Aime(MAA (Mathematical Association of America))0.1
Hle(Center for AI Safety + Scale AI (2025))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))No category score data available
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available