Skip to main content

Gemini 1.5 Flash-8B

GoogleGeminiProprietary

Description

A multimodal model capable of processing audio, images, video, and text with high efficiency. Features JSON mode, function calling, code execution, and system instructions support. Optimized for fast inference with 8B parameters.

Release Date
2024-10-03
Parameters
8.0B
Context Length
Modalities
image, text

Capability Radar

24
general
22
coding
29
reasoning
25
scienceest.
0
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking317
23.0
AA
General Ranking379
28.0
AA
Math Reasoning249
35.0
AA
Multimodal Ranking66
66.0
LS
Science386
26.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA38.4%SR

Finance

MMLU-Pro58.7%SR

General

Natural2Code75.5%SR
MRCR54.7%SR
MMMU53.7%SR
Vibe-Eval40.9%SR

Healthcare

WMT2372.6%SR

Language

FLEURS0.86 / 100SR

Math

MATH58.7%SR
MathVista54.7%SR
HiddenMath32.8%SR

Multimodal

Video-MME66.2%SR

Safety

XSTest92.6%SR

AA Evaluation Indices

Intelligence Index
11.1
Math 500
0.7
Mmlu Pro
0.6
Gpqa
0.4
Scicode
0.2
Livecodebench
0.2
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Speech To Text
90
Safety
90
Language
70
Finance
60
Healthcare
60
Legal
60
Vision
50
General
50
Long Context
50
Math
50
Multimodal
50
Reasoning
50
Biology
40
Chemistry
40
Physics
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s

Available Providers

(LS internal units)

No provider data available

External Sources