o1
OpenAIOpenAI o-seriesProprietary
Description
A research preview model focused on mathematical and logical reasoning capabilities, demonstrating improved performance on tasks requiring step-by-step reasoning, mathematical problem-solving, and code generation. The model shows enhanced capabilities in formal reasoning while maintaining strong general capabilities.
Date de sortie
2024-12-05
Paramètres
—
Longueur du contexte
200K
Modalités
image, pdf, text
Radar de capacités
35
general
51
coding
80
reasoning
54
science
60
agents
70
multimodal
Classements
| Domaine | #Rang | Score | Source |
|---|---|---|---|
| Classement codage | 276 | 53.0 | AA |
| Classement général | 187 | 56.0 | AA |
| Classement multimodal | 59 | 56.0 | LS |
| Science | 330 | 43.0 | AA |
Scores de benchmarks (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQA Biology
69.2%Aut.
Chat
TAU-bench Retail
70.8%Aut.
Factuality
SimpleQA
47.0%Aut.
General
MMLU
91.8%Aut.
Language
MMMLU
87.7%Aut.
Math
GSM8k
97.1%Aut.
MATH
96.4%Aut.
MGSM
89.3%Aut.
AIME 2024
74.3%Aut.
MathVista
71.8%Aut.
LiveBench
67.0%Aut.
FrontierMath
5.5%Aut.
Multimodal
MMMU
77.6%Aut.
Reasoning
GPQA Physics
92.8%Aut.
HumanEvalOpenAI (2021)
88.1%Aut.
GPQANYU + Cohere + Anthropic (2023)
78.0%Aut.
GPQA Chemistry
64.7%Aut.
TAU-bench Airline
50.0%Aut.
SWE-Bench Verified
41.0%Aut.
Indices d'évaluation AA
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))97.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))84.1
Gpqa(NYU + Cohere + Anthropic (2023))74.7
Aime(MAA (Mathematical Association of America))72.3
Ifbench(Google Research (2023))70.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))67.9
Lcr(Artificial Analysis)65.0
Tau2(Sierra + U Toronto + Vector Institute (2025))62.6
Coding Index(Artificial Analysis)39.7
Intelligence Index(Artificial Analysis)15.2
Terminalbench Hard(Stanford × Laude Institute (2026))12.9
Hle(Center for AI Safety + Scale AI (2025))7.0
Scores par catégorie LLM Stats
(LLM Stats (zeroeval))Language90
Legal90
Finance90
Math80
Physics80
Healthcare80
Biology80
Chemistry80
Chat70
Multimodal70
Reasoning70
General70
Vision70
Code60
Communication60
Tool Calling60
Factuality50
Frontend Development40
Tarification
Prix d'entrée$15 / 1M tokens
Prix de sortie$60 / 1M tokens
Prix mixte (3:1)$26.25 / 1M tokens
Prix de lecture cache$7.5 / 1M tokens
Vitesse
Tokens/sec0.0
Délai du premier token0.00s
Temps de réponse0.00s
Classement des Prix par Fournisseur
Classement des Prix par Fournisseur
14 fournisseurs
Moins cher: PoePlus cher: LLM Gateway
FournisseurEntréeSortie
1PoeMoins cher
$14
$54
2OpenAIPRINCIPAL
$15
$60
3NanoGPT
$15
$60
4OpenRouter
$15
$60
5Kilo Gateway
$15
$60
6Helicone
$15
$60
7Azure Cognitive Services
$15
$60
8Vercel AI Gateway
$15
$60
9DevPass (LLM Gateway)
$15
$60
10Azure
$15
$60
11Merge Gateway
$15
$60
12Impossibl
$15
$60
13Eden AI
$15
$60
14LLM Gateway
$15
$60
Comparer les prix entre différents fournisseurs API pour ce modèle.