Skip to main content

Grok 4

xAIGrokProprietary

Description

Grok 4, announced by xAI in summer 2025, represents a major leap in AI capabilities, described as 'the smartest AI in the world.' Built on version 6 of xAI's foundation model, it uses 100x more training compute than Grok 2 and 10x more reinforcement learning compute than Grok 3. The model achieves PhD-level performance across all academic disciplines simultaneously, scoring perfect on standardized tests like the SAT and near-perfect on graduate exams like the GRE. Unlike Grok 3, tool usage is built into the training process rather than relying on generalization. Trained using 200,000 GPUs, Grok 4 excels at complex reasoning, mathematical problem-solving, and coding tasks, though it has acknowledged weaknesses in multimodal capabilities that are being addressed in the next version.

Release Date
2025-07-10
Parameters
Context Length
256K
Modalities
file, image, text

Capability Radar

52
general
56
coding
94
reasoning
60
scienceest.
0
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking37
76.0
AA
General Ranking77
73.0
AA
Math Reasoning11
96.0
AA
Reasoning103
16.0
LS
Science43
74.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA87.5%SR

Code

LiveCodeBench79.0%SR

Math

AIME 202591.7%SR
HMMT2590.0%SR
Humanity's Last Exam40.0%SR
USAMO2537.5%SR

Reasoning

ARC-AGI v215.9%SR

AA Evaluation Indices

Math Index
92.7
Intelligence Index
41.5
Coding Index
40.5
Math 500
1.0
Aime
0.9
Aime 25
0.9
Gpqa
0.9
Mmlu Pro
0.9
Livecodebench
0.8
Tau2
0.7
Lcr
0.7
Ifbench
0.5
Scicode
0.5
Terminalbench Hard
0.4
Hle
0.2

LLM Stats Category Scores

Biology
90
Chemistry
90
Physics
90
Code
80
General
80
Math
60
Reasoning
60
Vision
30
Spatial Reasoning
20

Pricing

Input Price$4.25 / 1M tokens
Output Price$21.25 / 1M tokens
Blended Price (3:1)$8.5 / 1M tokens

Speed

Tokens/sec47.2 tokens/s
Time to First Token14.13s
Time to Answer14.13s

Available Providers

(LS internal units)

No provider data available

External Sources