Gemma 3 1B Instruct
GoogleGemmaOpen WeightGemma · Commercial OK
Description
The Gemma 3 1B model is a lightweight, 1-billion-parameter language model by Google, optimized for efficiency on resource-limited devices. At 529MB, it processes text at 2,585 tokens/second with a context window of 128,000 tokens. It supports 35+ languages but handles text-only input, unlike larger multimodal Gemma models. This balance of speed and efficiency makes it ideal for fast text processing on mobile and low-power devices.
Release Date
2025-03-13
Parameters
1.0B
Context Length
—
Modalities
—
Capability Radar
7
general
2
coding
11
reasoning
18
science
8
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 639 | 1.0 | AA |
| General Ranking | 660 | 7.0 | AA |
| Science | 643 | 12.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
80.2%SR
Factuality
SimpleQA
2.2%SR
General
Global-MMLU-Lite
34.2%SR
Language
WMT24++
35.9%SR
MMLU-Pro
14.7%SR
ECLeKTic
1.4%SR
Math
GSM8k
62.8%SR
MATH
48.0%SR
HiddenMath
15.8%SR
Reasoning
Natural2Code
56.0%SR
HumanEvalOpenAI (2021)
41.5%SR
BIG-Bench Hard
39.1%SR
FACTS Grounding
36.4%SR
MBPP
0.35 / 100SR
GPQANYU + Cohere + Anthropic (2023)
19.2%SR
BIG-Bench Extra Hard
7.2%SR
Bird-SQL (dev)
6.4%SR
LiveCodeBench
1.9%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))48.4
Gpqa(NYU + Cohere + Anthropic (2023))23.7
Ifbench(Google Research (2023))19.9
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))13.5
Tau2(Sierra + U Toronto + Vector Institute (2025))10.5
Hle(Center for AI Safety + Scale AI (2025))5.3
Intelligence Index(Artificial Analysis)4.8
Aime 25(MAA (Mathematical Association of America))3.3
Math Index(Artificial Analysis)3.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))1.7
Aime(MAA (Mathematical Association of America))0.0
Lcr(Artificial Analysis)0.0
Terminalbench Hard(Stanford × Laude Institute (2026))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat80
Instruction Following80
Structured Output80
Math40
Grounding40
Reasoning30
General30
Language20
Physics20
Factuality20
Biology20
Chemistry20
Code20
Legal10
Finance10
Healthcare10
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available