o3
OpenAIOpenAI o-seriesProprietary
Description
OpenAI's most powerful reasoning model. o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Use it to think through multi-step problems that involve analysis across text, code, and images.
Release Date
2025-04-16
Parameters
—
Context Length
200K
Modalities
image, pdf, text
Capability Radar
40
general
81
coding
90
reasoning
63
science
70
agents
85
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 133 | 76.0 | AA |
| General Ranking | 112 | 65.0 | AA |
| Multimodal Ranking | 42 | 59.0 | LS |
| Science | 204 | 58.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
Tau2 Airline
64.8%SR
Multi-Challenge
60.4%SR
Communication
Tau2 Retail
80.2%SR
Tau2 Telecom
58.2%SR
General
Aider-Polyglot
81.3%SR
Tau-bench
63.0%SR
Language
COLLIE
98.4%SR
Math
AIME 2024
91.6%SR
MathVista
86.8%SR
AIME 2025
86.4%SR
FrontierMath
15.8%SR
Multimodal
VideoMMMU
83.3%SR
MMMU
82.9%SR
Reasoning
ARC-AGI
88.0%SR
GPQANYU + Cohere + Anthropic (2023)
83.3%SR
CharXiv-R
78.6%SR
SWE-Bench Verified
69.1%SR
BrowseCompOpenAI (2025)
49.7%SR
Humanity's Last Exam
14.7%SR
ARC-AGI v2
6.5%
Vision
MMMU-Pro
76.4%SR
ERQA
64.0%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))99.2
Aime(MAA (Mathematical Association of America))90.3
Aime 25(MAA (Mathematical Association of America))88.3
Math Index(Artificial Analysis)88.3
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))85.3
Gpqa(NYU + Cohere + Anthropic (2023))82.7
Livecodebench(UC Berkeley + MIT + Cornell (2024))80.8
Tau2(Sierra + U Toronto + Vector Institute (2025))80.7
Lcr(Artificial Analysis)74.7
Ifbench(Google Research (2023))71.4
Terminalbench Hard(Stanford × Laude Institute (2026))37.1
Intelligence Index(Artificial Analysis)20.2
Hle(Center for AI Safety + Scale AI (2025))20.1
LLM Stats Category Scores
(LLM Stats (zeroeval))Language100
Writing100
Multimodal80
Physics80
Healthcare80
Biology80
Chemistry80
Code80
Reasoning70
Frontend Development70
General70
Communication70
Tool Calling70
Chat60
Math60
Agents60
Vision60
Search50
Spatial Reasoning50
Pricing
Input Price$2 / 1M tokens
Output Price$8 / 1M tokens
Blended Price (3:1)$3.5 / 1M tokens
Cache Read Price$0.5 / 1M tokens
Speed
Tokens/sec172.8
Time to First Token5.31s
Time to Answer5.31s
Provider Price Ranking
Provider Price Ranking
20 providers
Cheapest: PoeMost Expensive: Jiekou.AI
ProviderInputOutput
1PoeCheapest
$1.8
$7.2
2OpenAIPRIMARY
$2
$8
3302.AI
$2
$8
4NanoGPT
$2
$8
5Abacus
$2
$8
6OpenRouter
$2
$8
7Kilo Gateway
$2
$8
8Cloudflare AI Gateway
$2
$8
9Helicone
$2
$8
10AIHubMix
$2
$8
11Azure Cognitive Services
$2
$8
12Vercel AI Gateway
$2
$8
13DevPass (LLM Gateway)
$2
$8
14Azure
$2
$8
15NEAR AI Cloud
$2
$8
16Merge Gateway
$2
$8
17Impossibl
$2
$8
18Eden AI
$2
$8
19LLM Gateway
$2
$8
20Jiekou.AI
$10
$40
Compare pricing across different API providers for this model.