Skip to main content

Gemini 1.5 Flash-8B

GoogleGeminiProprietary

Description

A multimodal model capable of processing audio, images, video, and text with high efficiency. Features JSON mode, function calling, code execution, and system instructions support. Optimized for fast inference with 8B parameters.

Release Date
2024-10-03
Parameters
8.0B
Context Length
Modalities
image, text

Capability Radar

21
general
22
coding
30
reasoning
25
scienceest.
28
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking341
23.0
AA
General Ranking401
26.0
AA
Math Reasoning249
35.0
AA
Multimodal Ranking75
66.0
LS
Science409
25.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA38.4%SR

Finance

MMLU-Pro58.7%SR

General

Natural2Code75.5%SR
MRCR54.7%SR
MMMU53.7%SR
Vibe-Eval40.9%SR

Healthcare

WMT2372.6%SR

Language

FLEURS86.4%SR

Math

MATH58.7%SR
MathVista54.7%SR
HiddenMath32.8%SR

Multimodal

Video-MME66.2%SR

Safety

XSTest92.6%SR

AA Evaluation Indices

Intelligence Index
5.5
Math 500
0.7
Mmlu Pro
0.6
Gpqa
0.4
Scicode
0.2
Livecodebench
0.2
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Safety
90
Speech To Text
90
Language
70
Legal
60
Finance
60
Healthcare
60
Long Context
50
Math
50
Multimodal
50
Reasoning
50
General
50
Vision
50
Physics
40
Biology
40
Chemistry
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources