Skip to main content

Gemini 1.0 Pro

GoogleGeminiProprietary

Description

Gemini 1.0 Pro is a Natural Language Processing (NLP) model designed for tasks such as multi-turn text and code chat, and code generation. It supports text input and output, making it ideal for natural language tasks. The model is optimized for handling complex conversations and generating code snippets. It offers adjustable safety settings and supports function calling, but does not support JSON mode, JSON schema, or system instructions. The latest stable version is gemini-1.0-pro-001, and it was last updated in February 2024.

Release Date
2023-12-06
Parameters
Context Length
1.0M
Modalities
audio, file, image, text, video

Capability Radar

18
general
12
coding
18
reasoning
17
scienceest.
0
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking413
12.0
AA
General Ranking437
20.0
AA
Math Reasoning307
19.0
AA
Science442
16.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA27.9%SR

Finance

MMLU71.8%SR

General

MMMU47.9%SR

Healthcare

WMT2371.7%SR

Language

BIG-Bench75.0%SR
FLEURS0.06 / 100SR

Long Context

EgoSchema55.7%SR

Math

MathVista46.6%SR
MATH32.6%SR

AA Evaluation Indices

Intelligence Index
8.5
Mmlu Pro
0.4
Math 500
0.4
Gpqa
0.3
Scicode
0.1
Livecodebench
0.1
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Finance
70
Legal
70
Healthcare
60
Language
60
Long Context
60
Math
60
Vision
50
General
50
Multimodal
50
Reasoning
50
Biology
30
Chemistry
30
Physics
30
Speech To Text
10

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s

Available Providers

(LS internal units)

No provider data available

External Sources