Gemini 1.5 Flash (Sep '24)
GoogleGeminiProprietary
Description
Gemini 1.5 Flash is a fast and versatile multimodal model for scaling across diverse tasks. It supports audio, images, video, and text input, and produces text output. The model is optimized for generating code, extracting data, editing text, and more, making it ideal for narrow, high-frequency tasks.
Release Date
2024-09-24
Parameters
—
Context Length
—
Modalities
image, text
Capability Radar
70
general
70
coding
70
reasoning
43
scienceest.
70
agents
80
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Multimodal Ranking | 93 | 46.0 | LS |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
78.9%SR
Language
FLEURS
90.4%SR
WMT23
74.1%SR
MMLU-Pro
67.3%SR
Long Context
MRCR
71.9%SR
Math
GSM8k
86.2%SR
MGSM
82.6%SR
MATH
77.9%SR
MathVista
65.8%SR
FunctionalMATH
53.6%SR
HiddenMath
47.2%SR
AMC_2022_23
34.8%SR
Multimodal
Video-MME
76.1%SR
MMMU
62.3%SR
Vibe-Eval
48.9%SR
Physics
PhysicsFinals
57.4%SR
Reasoning
HellaSwagAI2 (2019)
86.5%SR
BIG-Bench Hard
85.5%SR
Natural2Code
79.8%SR
HumanEvalOpenAI (2021)
74.3%SR
GPQANYU + Cohere + Anthropic (2023)
51.0%SR
Safety
XSTest
97.0%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Safety100
Speech To Text90
Language80
Legal70
Long Context70
Math70
Reasoning70
Finance70
General70
Healthcare70
Code70
Multimodal60
Vision60
Physics50
Biology50
Chemistry50
Pricing
No pricing data available
Speed
No speed data available
Provider Price Ranking
No provider data available