Gemma 2 27B
GoogleGemmaOpen WeightGemma · Commercial OK
Description
Gemma 2 27B IT is an instruction-tuned version of Google's state-of-the-art open language model. Built from the same research and technology as Gemini, it's optimized for dialogue applications through supervised fine-tuning, distillation from larger models, and RLHF. The model excels at text generation tasks including question answering, summarization, and reasoning.
Release Date
2024-06-27
Parameters
27.2B
Context Length
8K
Modalities
text
Capability Radar
70
general
50
coding
60
reasoning
68
scienceest.
0
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Reasoning | 20 | 86.0 | LS |
Benchmark Scores (LLM Stats)
Code
HumanEval
51.8%SR
Creativity
Social IQa
53.7%SR
Finance
MMLU
75.2%SR
General
ARC-E
88.6%SR
TriviaQA
83.7%SR
PIQA
83.2%SR
ARC-C
71.4%SR
MBPP
0.63 / 100SR
AGIEval
55.1%SR
Natural Questions
34.5%SR
Language
BoolQ
84.8%SR
Winogrande
83.7%SR
BIG-Bench
74.9%SR
Math
GSM8k
74.0%SR
MATH
42.3%SR
Reasoning
HellaSwag
86.4%SR
AA Evaluation Indices
No AA evaluation data available
LLM Stats Category Scores
Finance80
Healthcare80
Language80
Physics80
General70
Legal70
Reasoning70
Math60
Code50
Creativity50
Psychology50
Search30
Pricing
Input Price$0.65 / 1M tokens
Output Price$0.65 / 1M tokens
Blended Price (3:1)$0.65 / 1M tokens
Speed
No speed data available
Available Providers
(LS internal units)No provider data available