Gemini 1.0 Pro
GoogleGeminiProprietary
Description
Gemini 1.0 Pro is a Natural Language Processing (NLP) model designed for tasks such as multi-turn text and code chat, and code generation. It supports text input and output, making it ideal for natural language tasks. The model is optimized for handling complex conversations and generating code snippets. It offers adjustable safety settings and supports function calling, but does not support JSON mode, JSON schema, or system instructions. The latest stable version is gemini-1.0-pro-001, and it was last updated in February 2024.
Release Date
2023-12-06
Parameters
—
Context Length
—
Modalities
text
Capability Radar
15
general
12
coding
18
reasoning
17
scienceest.
16
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 428 | 12.0 | AA |
| General Ranking | 462 | 18.0 | AA |
| Math Reasoning | 307 | 19.0 | AA |
| Science | 465 | 16.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
27.9%SR
Finance
MMLU
71.8%SR
General
MMMU
47.9%SR
Healthcare
WMT23
71.7%SR
Language
FLEURS
93.6%SR
BIG-Bench
75.0%SR
Long Context
EgoSchema
55.7%SR
Math
MathVista
46.6%SR
MATH
32.6%SR
AA Evaluation Indices
Intelligence Index3.1
Mmlu Pro0.4
Math 5000.4
Gpqa0.3
Scicode0.1
Livecodebench0.1
Hle0.0
Aime0.0
LLM Stats Category Scores
Speech To Text90
Language80
Legal70
Finance70
Long Context60
Math60
Healthcare60
Multimodal50
Reasoning50
General50
Vision50
Physics30
Biology30
Chemistry30
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available