Skip to main content

Gemini 1.0 Pro

GoogleGeminiProprietary

Description

Gemini 1.0 Pro is a Natural Language Processing (NLP) model designed for tasks such as multi-turn text and code chat, and code generation. It supports text input and output, making it ideal for natural language tasks. The model is optimized for handling complex conversations and generating code snippets. It offers adjustable safety settings and supports function calling, but does not support JSON mode, JSON schema, or system instructions. The latest stable version is gemini-1.0-pro-001, and it was last updated in February 2024.

Release Date
2023-12-06
Parameters
Context Length
Modalities
text

Capability Radar

15
general
12
coding
18
reasoning
17
scienceest.
16
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking428
12.0
AA
General Ranking462
18.0
AA
Math Reasoning307
19.0
AA
Science465
16.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA27.9%SR

Finance

MMLU71.8%SR

General

MMMU47.9%SR

Healthcare

WMT2371.7%SR

Language

FLEURS93.6%SR
BIG-Bench75.0%SR

Long Context

EgoSchema55.7%SR

Math

MathVista46.6%SR
MATH32.6%SR

AA Evaluation Indices

Intelligence Index
3.1
Mmlu Pro
0.4
Math 500
0.4
Gpqa
0.3
Scicode
0.1
Livecodebench
0.1
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Speech To Text
90
Language
80
Legal
70
Finance
70
Long Context
60
Math
60
Healthcare
60
Multimodal
50
Reasoning
50
General
50
Vision
50
Physics
30
Biology
30
Chemistry
30

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources