Gemini 1.5 Flash-8B
GoogleGeminiProprietary
Description
A multimodal model capable of processing audio, images, video, and text with high efficiency. Features JSON mode, function calling, code execution, and system instructions support. Optimized for fast inference with 8B parameters.
Release Date
2024-10-03
Parameters
8.0B
Context Length
—
Modalities
image, text
Capability Radar
21
general
22
coding
30
reasoning
25
science
28
agents
80
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 404 | 23.0 | AA |
| General Ranking | 472 | 25.0 | AA |
| Multimodal Ranking | 68 | 37.0 | LS |
| Science | 474 | 25.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
38.4%SR
Finance
MMLU-Pro
58.7%SR
General
Natural2Code
75.5%SR
MRCR
54.7%SR
MMMU
53.7%SR
Vibe-Eval
40.9%SR
Healthcare
WMT23
72.6%SR
Language
FLEURS
86.4%SR
Math
MATH
58.7%SR
MathVista
54.7%SR
HiddenMath
32.8%SR
Multimodal
Video-MME
66.2%SR
Safety
XSTest
92.6%SR
AA Evaluation Indices
(Artificial Analysis)Intelligence Index(Artificial Analysis)5.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.6
Gpqa(NYU + Cohere + Anthropic (2023))0.4
Scicode(UIUC + Argonne National Lab (2024))0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.2
Hle(Center for AI Safety + Scale AI (2025))0.0
Aime(MAA (Mathematical Association of America))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Safety90
Speech To Text90
Language70
Legal60
Finance60
General60
Healthcare60
Long Context50
Math50
Multimodal50
Reasoning50
Vision50
Physics40
Biology40
Chemistry40
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available