Gemma 2 27B
GoogleGemmaOpen WeightGemma · Commercial OK
描述
Gemma 2 27B IT is an instruction-tuned version of Google's state-of-the-art open language model. Built from the same research and technology as Gemini, it's optimized for dialogue applications through supervised fine-tuning, distillation from larger models, and RLHF. The model excels at text generation tasks including question answering, summarization, and reasoning.
發布日期
2024-06-27
參數規模
27.2B
上下文長度
8K
支援模態
text
能力雷達圖
70
general
50
coding
60
reasoning
68
science估算
0
agents
0
multimodal
Science 在缺少專門科學評測時使用推理能力代理估算。
排行榜排名
| 領域 | #排名 | 分數 | 來源 |
|---|---|---|---|
| 推理能力 | 20 | 86.0 | LS |
基準測試分數 (LLM Stats)
Code
HumanEval
51.8%自報
Creativity
Social IQa
53.7%自報
Finance
MMLU
75.2%自報
General
ARC-E
88.6%自報
TriviaQA
83.7%自報
PIQA
83.2%自報
ARC-C
71.4%自報
MBPP
0.63 / 100自報
AGIEval
55.1%自報
Natural Questions
34.5%自報
Language
BoolQ
84.8%自報
Winogrande
83.7%自報
BIG-Bench
74.9%自報
Math
GSM8k
74.0%自報
MATH
42.3%自報
Reasoning
HellaSwag
86.4%自報
AA 評測指數
暫無 AA 評測資料
LLM Stats 分類評分
Finance80
Healthcare80
Language80
Physics80
General70
Legal70
Reasoning70
Math60
Code50
Creativity50
Psychology50
Search30
定價
輸入價格$0.65 / 1M tokens
輸出價格$0.65 / 1M tokens
混合價格(3:1)$0.65 / 1M tokens
速度
暫無速度資料
可用提供商
(LS 內部計價單位)暫無提供商資料