Gemini 1.0 Pro
GoogleGeminiProprietary
Description
Gemini 1.0 Pro is a Natural Language Processing (NLP) model designed for tasks such as multi-turn text and code chat, and code generation. It supports text input and output, making it ideal for natural language tasks. The model is optimized for handling complex conversations and generating code snippets. It offers adjustable safety settings and supports function calling, but does not support JSON mode, JSON schema, or system instructions. The latest stable version is gemini-1.0-pro-001, and it was last updated in February 2024.
Release Date
2023-12-06
Parameters
—
Context Length
—
Modalities
text
Capability Radar
15
general
12
coding
18
reasoning
17
science
16
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 490 | 12.0 | AA |
| General Ranking | 531 | 17.0 | AA |
| Science | 533 | 15.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
27.9%
Finance
MMLU
71.8%SR
General
MMMU
47.9%
Healthcare
WMT23
71.7%
Language
FLEURS
93.6%
BIG-Bench
75.0%
Long Context
EgoSchema
55.7%SR
Math
MathVista
46.6%
MATH
32.6%
AA Evaluation Indices
(Artificial Analysis)Intelligence Index(Artificial Analysis)2.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.4
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.4
Gpqa(NYU + Cohere + Anthropic (2023))0.3
Scicode(UIUC + Argonne National Lab (2024))0.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.1
Hle(Center for AI Safety + Scale AI (2025))0.0
Aime(MAA (Mathematical Association of America))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Speech To Text90
Language80
Legal70
Finance70
Long Context60
Math60
General60
Healthcare60
Multimodal50
Reasoning50
Vision50
Physics30
Biology30
Chemistry30
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available