Skip to main content

o1

OpenAIOpenAI o-seriesProprietary

Description

A research preview model focused on mathematical and logical reasoning capabilities, demonstrating improved performance on tasks requiring step-by-step reasoning, mathematical problem-solving, and code generation. The model shows enhanced capabilities in formal reasoning while maintaining strong general capabilities.

Release Date
2024-12-05
Parameters
—
Context Length
200K
Modalities
image, pdf, text

Capability Radar

70
general
60
coding
80
reasoning
68
scienceest.
60
agents
70
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQA Biology69.2%SR

Chat

TAU-bench Retail70.8%SR

Factuality

SimpleQA47.0%SR

General

MMLU91.8%SR

Language

MMMLU87.7%SR

Math

GSM8k97.1%SR
MATH96.4%SR
MGSM89.3%SR
AIME 202474.3%SR
MathVista71.8%SR
LiveBench67.0%SR
FrontierMath5.5%SR

Multimodal

MMMU77.6%SR

Reasoning

GPQA Physics92.8%SR
HumanEvalOpenAI (2021)88.1%SR
GPQANYU + Cohere + Anthropic (2023)78.0%SR
GPQA Chemistry64.7%SR
TAU-bench Airline50.0%SR
SWE-Bench Verified41.0%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
90
Legal
90
Finance
90
Math
80
Physics
80
Healthcare
80
Biology
80
Chemistry
80
Chat
70
Multimodal
70
Reasoning
70
General
70
Vision
70
Code
60
Communication
60
Tool Calling
60
Factuality
50
Frontend Development
40

Pricing

Input Price$15 / 1M tokens
Output Price$60 / 1M tokens
Blended Price (3:1)$26.25 / 1M tokens
Cache Read Price$7.5 / 1M tokens

Speed

No speed data available

Provider Price Ranking

Provider Price Ranking

4 providers

Cheapest: OpenAIMost Expensive: Azure
ProviderInputOutput
1OpenAIPRIMARY
$15
$60
2Helicone
$15
$60
3Azure Cognitive Services
$15
$60
4Azure
$15
$60

Compare pricing across different API providers for this model.

External Sources