Skip to main content
AITier

o3

OpenAIOpenAI o-seriesProprietary

Description

OpenAI's most powerful reasoning model. o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Use it to think through multi-step problems that involve analysis across text, code, and images.

Release Date
2025-04-16
Parameters
—
Context Length
200K
Modalities
file, image, text

Capability Radar

50
general
54
coding
90
reasoning
56
scienceest.
70
agents
85
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Agents & Tools50
57.0
LS
Code Ranking41
74.0
AA
General Ranking55
77.0
AA
Math Reasoning28
92.0
AA
Multimodal Ranking33
79.0
LS
Reasoning81
53.0
LS
Science73
66.0
AA

Benchmark Scores (LLM Stats)

Agents

Tau-bench63.0%SR
BrowseComp49.7%SR

Biology

GPQA83.3%SR

Code

Aider-Polyglot81.3%SR
SWE-Bench Verified69.1%SR

Communication

Tau2 Retail80.2%SR
Tau2 Airline64.8%SR
Multi-Challenge60.4%SR
Tau2 Telecom58.2%SR

General

MMMU82.9%SR
MMMU-Pro76.4%SR

Healthcare

VideoMMMU83.3%SR

Language

COLLIE98.4%SR

Math

AIME 202491.6%SR
MathVista86.8%SR
AIME 202586.4%SR
FrontierMath15.8%SR
Humanity's Last Exam14.7%SR

Multimodal

CharXiv-R78.6%SR

Reasoning

ARC-AGI88.0%SR
ERQA64.0%SR
ARC-AGI v26.5%SR

AA Evaluation Indices

Math Index
88.3
Intelligence Index
38.4
Coding Index
38.4
Math 500
1.0
Aime
0.9
Aime 25
0.9
Mmlu Pro
0.9
Gpqa
0.8
Livecodebench
0.8
Tau2
0.8
Ifbench
0.7
Lcr
0.7
Scicode
0.4
Terminalbench Hard
0.4
Hle
0.2

LLM Stats Category Scores

Writing
100
Language
100
Biology
80
Chemistry
80
Code
80
General
80
Healthcare
80
Multimodal
80
Physics
80
Tool Calling
70
Communication
70
Frontend Development
70
Reasoning
70
Vision
60
Agents
60
Math
60
Spatial Reasoning
50
Search
50

Pricing

Input Price$2 / 1M tokens
Output Price$8 / 1M tokens
Blended Price (3:1)$3.5 / 1M tokens

Speed

Tokens/sec92.1 tokens/s
Time to First Token9.54s
Time to Answer9.54s

Available Providers

(LS internal units)

No provider data available

External Sources

LLM Stats