o1
OpenAIOpenAI o-seriesProprietary
Description
A research preview model focused on mathematical and logical reasoning capabilities, demonstrating improved performance on tasks requiring step-by-step reasoning, mathematical problem-solving, and code generation. The model shows enhanced capabilities in formal reasoning while maintaining strong general capabilities.
Release Date
2024-12-05
Parameters
—
Context Length
200K
Modalities
image, pdf, text
Capability Radar
70
general
60
coding
80
reasoning
68
scienceest.
60
agents
70
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQA Biology
69.2%SR
Chat
TAU-bench Retail
70.8%SR
Factuality
SimpleQA
47.0%SR
General
MMLU
91.8%SR
Language
MMMLU
87.7%SR
Math
GSM8k
97.1%SR
MATH
96.4%SR
MGSM
89.3%SR
AIME 2024
74.3%SR
MathVista
71.8%SR
LiveBench
67.0%SR
FrontierMath
5.5%SR
Multimodal
MMMU
77.6%SR
Reasoning
GPQA Physics
92.8%SR
HumanEvalOpenAI (2021)
88.1%SR
GPQANYU + Cohere + Anthropic (2023)
78.0%SR
GPQA Chemistry
64.7%SR
TAU-bench Airline
50.0%SR
SWE-Bench Verified
41.0%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Language90
Legal90
Finance90
Math80
Physics80
Healthcare80
Biology80
Chemistry80
Chat70
Multimodal70
Reasoning70
General70
Vision70
Code60
Communication60
Tool Calling60
Factuality50
Frontend Development40
Pricing
Input Price$15 / 1M tokens
Output Price$60 / 1M tokens
Blended Price (3:1)$26.25 / 1M tokens
Cache Read Price$7.5 / 1M tokens
Speed
No speed data available
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: OpenAIMost Expensive: Azure
ProviderInputOutput
1OpenAIPRIMARY
$15
$60
2Helicone
$15
$60
3Azure Cognitive Services
$15
$60
4Azure
$15
$60
Compare pricing across different API providers for this model.