Skip to main content

o3

OpenAIOpenAI o-seriesProprietary

Description

OpenAI's most powerful reasoning model. o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Use it to think through multi-step problems that involve analysis across text, code, and images.

Release Date
2025-04-16
Parameters
Context Length
200K
Modalities
image, pdf, text

Capability Radar

45
general
72
coding
90
reasoning
56
scienceest.
70
agents
85
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Agentic Capability48
57.0
LS
Code Ranking30
80.0
AA
General Ranking64
72.0
AA
Math Reasoning28
92.0
AA
Multimodal Ranking38
79.0
LS
Reasoning86
53.0
LS
Science87
63.0
AA

Benchmark Scores (LLM Stats)

Agents

Tau-bench63.0%SR
BrowseComp49.7%SR

Biology

GPQA83.3%SR

Code

Aider-Polyglot81.3%SR
SWE-Bench Verified69.1%SR

Communication

Tau2 Retail80.2%SR
Tau2 Airline64.8%SR
Multi-Challenge60.4%SR
Tau2 Telecom58.2%SR

General

MMMU82.9%SR
MMMU-Pro76.4%SR

Healthcare

VideoMMMU83.3%SR

Language

COLLIE98.4%SR

Math

AIME 202491.6%SR
MathVista86.8%SR
AIME 202586.4%SR
FrontierMath15.8%SR
Humanity's Last Exam14.7%SR

Multimodal

CharXiv-R78.6%SR

Reasoning

ARC-AGI88.0%SR
ERQA64.0%SR
ARC-AGI v26.5%SR

AA Evaluation Indices

Math Index
88.3
Intelligence Index
30.4
Math 500
1.0
Aime
0.9
Aime 25
0.9
Mmlu Pro
0.9
Gpqa
0.8
Livecodebench
0.8
Tau2
0.8
Ifbench
0.7
Lcr
0.7
Scicode
0.4
Terminalbench Hard
0.4
Hle
0.2

LLM Stats Category Scores

Language
100
Writing
100
Multimodal
80
Physics
80
General
80
Healthcare
80
Biology
80
Chemistry
80
Code
80
Reasoning
70
Frontend Development
70
Communication
70
Tool Calling
70
Math
60
Agents
60
Vision
60
Search
50
Spatial Reasoning
50

Pricing

Input Price$2 / 1M tokens
Output Price$8 / 1M tokens
Blended Price (3:1)$3.5 / 1M tokens
Cache Read Price$0.5 / 1M tokens

Speed

Tokens/sec168.9
Time to First Token6.19s
Time to Answer6.19s

Provider Price Ranking

Provider Price Ranking

16 providers

Cheapest: PoeMost Expensive: Jiekou.AI
ProviderInputOutput
1PoeCheapest
$1.8
$7.2
2OpenAIPRIMARY
$2
$8
3NanoGPT
$2
$8
4Abacus
$2
$8
5OpenRouter
$2
$8
6Kilo Gateway
$2
$8
7Cloudflare AI Gateway
$2
$8
8Helicone
$2
$8
9Azure Cognitive Services
$2
$8
10DigitalOcean
$2
$8
11Vercel AI Gateway
$2
$8
12LLM Gateway
$2
$8
13Azure
$2
$8
14NEAR AI Cloud
$2
$8
15Merge Gateway
$2
$8
16Jiekou.AI
$10
$40

Compare pricing across different API providers for this model.

External Sources