跳转到主要内容

Gemini 1.5 Flash (Sep '24)

GoogleGeminiProprietary

描述

Gemini 1.5 Flash is a fast and versatile multimodal model for scaling across diverse tasks. It supports audio, images, video, and text input, and produces text output. The model is optimized for generating code, extracting data, editing text, and more, making it ideal for narrow, high-frequency tasks.

发布日期
2024-09-24
参数规模
—
上下文长度
—
支持模态
image, text

能力雷达图

25
general
27
coding
43
reasoning
33
science
38
agents
80
multimodal

排行榜排名

领域#排名分数来源
代码能力榜437
30.0
AA
通用能力榜470
30.0
AA
多模态榜105
43.0
LS
科学能力540
23.0
AA

基准测试分数 (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU78.9%自报

Language

FLEURS90.4%自报
WMT2374.1%自报
MMLU-Pro67.3%自报

Long Context

MRCR71.9%自报

Math

GSM8k86.2%自报
MGSM82.6%自报
MATH77.9%自报
MathVista65.8%自报
FunctionalMATH53.6%自报
HiddenMath47.2%自报
AMC_2022_2334.8%自报

Multimodal

Video-MME76.1%自报
MMMU62.3%自报
Vibe-Eval48.9%自报

Physics

PhysicsFinals57.4%自报

Reasoning

HellaSwagAI2 (2019)86.5%自报
BIG-Bench Hard85.5%自报
Natural2Code79.8%自报
HumanEvalOpenAI (2021)74.3%自报
GPQANYU + Cohere + Anthropic (2023)51.0%自报

Safety

XSTest97.0%自报

AA 评测指数

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
82.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
68.0
Gpqa(NYU + Cohere + Anthropic (2023))
46.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))
27.3
Aime(MAA (Mathematical Association of America))
18.0
Intelligence Index(Artificial Analysis)
7.1
Hle(Center for AI Safety + Scale AI (2025))
3.2

LLM Stats 分类评分

(LLM Stats (zeroeval))
Safety
100
Speech To Text
90
Language
80
Legal
70
Long Context
70
Math
70
Reasoning
70
Finance
70
General
70
Healthcare
70
Code
70
Multimodal
60
Vision
60
Physics
50
Biology
50
Chemistry
50

定价

输入价格免费
输出价格免费
混合价格(3:1)免费

速度

Tokens/秒0.0
首Token延迟0.00s
首回答延迟0.00s

供应商价格排行

暂无提供商数据

外部链接