Skip to main content

Gemma 2 27B

GoogleGemmaOpen WeightGemma · Commercial OK

Description

Gemma 2 27B IT is an instruction-tuned version of Google's state-of-the-art open language model. Built from the same research and technology as Gemini, it's optimized for dialogue applications through supervised fine-tuning, distillation from larger models, and RLHF. The model excels at text generation tasks including question answering, summarization, and reasoning.

Release Date
2024-06-27
Parameters
27.2B
Context Length
8K
Modalities
text

Capability Radar

70
general
50
coding
60
reasoning
68
scienceest.
0
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Reasoning20
86.0
LS

Benchmark Scores (LLM Stats)

Code

HumanEval51.8%SR

Creativity

Social IQa53.7%SR

Finance

MMLU75.2%SR

General

ARC-E88.6%SR
TriviaQA83.7%SR
PIQA83.2%SR
ARC-C71.4%SR
MBPP0.63 / 100SR
AGIEval55.1%SR
Natural Questions34.5%SR

Language

BoolQ84.8%SR
Winogrande83.7%SR
BIG-Bench74.9%SR

Math

GSM8k74.0%SR
MATH42.3%SR

Reasoning

HellaSwag86.4%SR

AA Evaluation Indices

No AA evaluation data available

LLM Stats Category Scores

Finance
80
Healthcare
80
Language
80
Physics
80
General
70
Legal
70
Reasoning
70
Math
60
Code
50
Creativity
50
Psychology
50
Search
30

Pricing

Input Price$0.65 / 1M tokens
Output Price$0.65 / 1M tokens
Blended Price (3:1)$0.65 / 1M tokens

Speed

No speed data available

Available Providers

(LS internal units)

No provider data available

External Sources