Gemini 1.5 Flash (Sep '24)

GoogleGeminiProprietary

描述

Gemini 1.5 Flash is a fast and versatile multimodal model for scaling across diverse tasks. It supports audio, images, video, and text input, and produces text output. The model is optimized for generating code, extracting data, editing text, and more, making it ideal for narrow, high-frequency tasks.

发布日期

2024-09-24

参数规模

—

上下文长度

—

支持模态

image, text

能力雷达图

general

coding

reasoning

science

agents

multimodal

排行榜排名

领域	#排名	分数	来源
代码能力榜	349	30.0	AA
通用能力榜	402	32.0	AA
多模态榜	47	46.0	LS
科学能力	434	30.0	AA

基准测试分数 (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)

51.0%自报

Code

HumanEvalOpenAI (2021)

74.3%自报

Finance

MMLU

78.9%自报

MMLU-Pro

67.3%自报

General

Natural2Code

79.8%自报

MRCR

71.9%自报

MMMU

62.3%自报

Vibe-Eval

48.9%自报

Healthcare

WMT23

74.1%自报

Language

FLEURS

90.4%自报

BIG-Bench Hard

85.5%自报

Math

GSM8k

86.2%自报

MGSM

82.6%自报

MATH

77.9%自报

MathVista

65.8%自报

PhysicsFinals

57.4%自报

FunctionalMATH

53.6%自报

HiddenMath

47.2%自报

AMC_2022_23

34.8%自报

Multimodal

Video-MME

76.1%自报

Reasoning

HellaSwagAI2 (2019)

86.5%自报

Safety

XSTest

97.0%自报

AA 评测指数

(Artificial Analysis)

Intelligence Index(Artificial Analysis)

7.8

Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))

0.8

Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))

0.7

Gpqa(NYU + Cohere + Anthropic (2023))

0.5

Livecodebench(UC Berkeley + MIT + Cornell (2024))

0.3

Scicode(UIUC + Argonne National Lab (2024))

0.3

Aime(MAA (Mathematical Association of America))

0.2

Hle(Center for AI Safety + Scale AI (2025))

0.0

LLM Stats 分类评分

(LLM Stats (zeroeval))

Safety

100

Speech To Text

Language

Legal

Long Context

Math

Reasoning

Finance

General

Healthcare

Code

Multimodal

Vision

Physics

Biology

Chemistry

定价

输入价格免费

输出价格免费

混合价格(3:1)免费

速度

Tokens/秒0.0

首Token延迟0.00s

首回答延迟0.00s

供应商价格排行

暂无提供商数据

外部链接

LLM Stats Artificial Analysis