Gemma 3 12B Instruct
GoogleGemmaOpen WeightGemma · Commercial OK
描述
Gemma 3 12B is a 12-billion-parameter vision-language model from Google, handling text and image input and generating text output. It features a 128K context window, multilingual support, and open weights. Suitable for question answering, summarization, reasoning, and image understanding tasks.
发布日期
2025-03-12
参数规模
12.0B
上下文长度
131K
支持模态
image, text
能力雷达图
23
general
10
coding
31
reasoning
23
science估算
0
agents
80
multimodal
Science 在缺少专门科学评测时使用推理能力代理估算。
排行榜排名
基准测试分数 (LLM Stats)
Biology
GPQA
40.9%自报
Code
HumanEval
85.4%自报
LiveCodeBench
24.6%自报
Factuality
FACTS Grounding
75.8%自报
SimpleQA
6.3%自报
Finance
MMLU-Pro
60.6%自报
General
IFEval
88.9%自报
Natural2Code
80.7%自报
MBPP
0.73 / 100自报
Global-MMLU-Lite
69.5%自报
MMMU (val)
59.6%自报
BIG-Bench Extra Hard
16.3%自报
Image To Text
DocVQA
87.1%自报
VQAv2 (val)
71.6%自报
TextVQA
67.7%自报
Language
BIG-Bench Hard
85.7%自报
WMT24++
51.6%自报
ECLeKTic
10.3%自报
Math
GSM8k
94.4%自报
MATH
83.8%自报
MathVista-Mini
62.9%自报
HiddenMath
54.5%自报
Multimodal
AI2D
84.2%自报
ChartQA
75.7%自报
InfoVQA
64.9%自报
Reasoning
Bird-SQL (dev)
47.9%自报
AA 评测指数
Math Index18.3
Intelligence Index8.8
Coding Index6.3
Math 5000.9
Mmlu Pro0.6
Ifbench0.4
Gpqa0.3
Aime0.2
Aime 250.2
Scicode0.2
Livecodebench0.1
Tau20.1
Lcr0.1
Hle0.0
Terminalbench Hard0.0
LLM Stats 分类评分
Structured Output90
Instruction Following90
Grounding80
Image To Text80
Vision70
Math70
Multimodal70
Code60
Finance60
Healthcare60
Legal60
Reasoning60
General50
Language50
Biology40
Chemistry40
Factuality40
Physics40
定价
输入价格$0.09 / 1M tokens
输出价格$0.29 / 1M tokens
混合价格(3:1)$0.14 / 1M tokens
速度
Tokens/秒27.2 tokens/s
首Token延迟1.77s
首回答延迟1.77s
可用提供商
(LS 内部计价单位)暂无提供商数据