Skip to main content

Grok Beta

SpaceXAIGrok
Release Date
2024-08-13
Parameters
Context Length
500K
Modalities
image, pdf, text

Capability Radar

26
general
25
coding
37
reasoning
32
science
33
agents
80
multimodal

Rankings

Domain#RankScoreSource
Code Ranking377
26.0
AA
General Ranking408
32.0
AA
Science407
33.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

No benchmark data available

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
7.3
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.7
Gpqa(NYU + Cohere + Anthropic (2023))
0.5
Scicode(UIUC + Argonne National Lab (2024))
0.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.2
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))

No category score data available

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.5 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: OpenRouterMost Expensive: Kilo Gateway
ProviderInputOutput
1OpenRouterCheapest
$2
$6
2Kilo Gateway
$2
$6

Compare pricing across different API providers for this model.

External Sources