Skip to main content

o3-mini

OpenAIOpenAI o-seriesProprietary

Description

A smaller variant of O3, expected to offer enhanced multimodal capabilities, improved reasoning, and more efficient resource utilization compared to previous models while maintaining strong performance on core tasks.

Release Date
2025-01-31
Parameters
Context Length
200K
Modalities
text

Capability Radar

35
general
65
coding
83
reasoning
49
science
40
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking270
44.0
AA
General Ranking296
44.0
AA
Science228
52.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)77.2%SR

Code

Aider-Polyglot66.7%SR
Aider-Polyglot Edit60.4%SR
SWE-Bench Verified49.3%SR
SWE-Lancer18.0%SR
SWE-Lancer (IC-Diamond subset)7.4%SR

Communication

Multi-IF79.5%SR
TAU-bench Retail57.6%SR
Multi-Challenge39.9%SR
TAU-bench Airline32.4%SR

Factuality

SimpleQA15.0%SR

Finance

MMLU86.9%SR

General

IFEvalGoogle Research (2023)93.9%SR
LiveBench84.6%SR
Multilingual MMLU80.7%SR
Internal API instruction following (hard)50.0%SR

Language

COLLIE98.7%SR

Long Context

OpenAI-MRCR: 2 needle 128k18.7%SR
ComplexFuncBench17.6%SR

Math

MATH97.9%SR
MGSM92.0%SR
AIME 202487.3%SR
FrontierMath9.2%SR

Reasoning

Graphwalks parents <128k58.3%SR
Graphwalks BFS <128k51.0%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
19.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
1.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.8
Aime(MAA (Mathematical Association of America))
0.8
Gpqa(NYU + Cohere + Anthropic (2023))
0.7
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.7
Scicode(UIUC + Argonne National Lab (2024))
0.4
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.3
Hle(Center for AI Safety + Scale AI (2025))
0.1
Terminalbench Hard(Stanford × Laude Institute (2026))
0.1

LLM Stats Category Scores

(LLM Stats (zeroeval))
Writing
100
Legal
90
Instruction Following
90
Language
90
Finance
90
Healthcare
90
Math
80
Physics
80
Biology
80
Chemistry
80
Reasoning
60
Structured Output
60
General
60
Spatial Reasoning
50
Frontend Development
50
Communication
50
Code
40
Tool Calling
40
Long Context
20
Factuality
10

Pricing

Input Price$1.1 / 1M tokens
Output Price$4.4 / 1M tokens
Blended Price (3:1)$1.925 / 1M tokens
Cache Read Price$0.55 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1OpenAIPRIMARY
$1.1
$4.4

Compare pricing across different API providers for this model.

External Sources