Skip to main content

K2 Horizon 3.7B

Institute of Foundation ModelsOpen WeightApache 2.0 · Commercial OK

Description

K2 Horizon 3.7B is the small dense member of IFM's (MBZUAI) fully open K2 Horizon family: a 3.7B-core decoder-only reasoning model (36 layers; about 5.1B parameters in the released safetensors including its 250K-token vocabulary embeddings) pretrained on 22.9T tokens, with a native 524,288-token (512K) context window from midtraining onward. Text in, text out, with per-request reasoning effort (high recommended) and JSON/XML tool-call formats. Released 2026-09-03 under Apache 2.0; on 2026-10-01 the main branch was updated to an anti-doom-loop (FTPO) checkpoint, and the model-card scores were refreshed on 2026-10-28 (they differ from the launch-blog figures). BF16 weights plus a GGUF build, intermediate checkpoints, training data, code, and logs. No priced provider is cataloged yet.

Release Date
2026-09-03
Parameters
3.7B
Context Length
—
Modalities
—

Capability Radar

50
general
40
coding
40
reasoning
43
scienceest.
40
agents
10
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

Domain#RankScoreSource
Agentic Capability72
47.0
LS

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Agents

Tau3 Banking17.7%SR

Math

HMMT Feb 2675.2%SR

Reasoning

GPQANYU + Cohere + Anthropic (2023)68.9%SR
SWE-Bench Verified65.6%SR
Terminal-Bench 2.139.7%SR
SciCode25.8%SR
Humanity's Last Exam14.0%SR

Tool Calling

BFCL-V464.6%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Frontend Development
70
Physics
50
General
50
Biology
50
Chemistry
50
Math
40
Reasoning
40
Agents
40
Code
40
Tool Calling
40
Vision
10

Pricing

No pricing data available

Speed

No speed data available

Provider Price Ranking

No provider data available

External Sources