Passer au contenu principal

o3-mini

OpenAIOpenAI o-seriesProprietary

Description

A smaller variant of O3, expected to offer enhanced multimodal capabilities, improved reasoning, and more efficient resource utilization compared to previous models while maintaining strong performance on core tasks.

Date de sortie
2025-01-31
Paramètres
Longueur du contexte
200K
Modalités
file, text

Radar de capacités

39
general
39
coding
83
reasoning
49
scienceest.
40
agents
85
multimodal

Science utilise un proxy de raisonnement lorsque les benchmarks scientifiques dédiés ne sont pas disponibles.

Classements

Domaine#RangScoreSource
Code Ranking230
37.0
AA
General Ranking214
48.0
AA
Math Reasoning50
89.0
AA
Reasoning78
54.0
LS
Science146
54.0
AA

Scores de benchmarks (LLM Stats)

Biology

GPQA77.2%Aut.

Code

Aider-Polyglot66.7%Aut.
Aider-Polyglot Edit60.4%Aut.
SWE-Bench Verified49.3%Aut.
SWE-Lancer18.0%Aut.
SWE-Lancer (IC-Diamond subset)7.4%Aut.

Communication

Multi-IF79.5%Aut.
TAU-bench Retail57.6%Aut.
Multi-Challenge39.9%Aut.
TAU-bench Airline32.4%Aut.

Factuality

SimpleQA15.0%Aut.

Finance

MMLU86.9%Aut.

General

IFEval93.9%Aut.
LiveBench84.6%Aut.
Multilingual MMLU80.7%Aut.
Internal API instruction following (hard)50.0%Aut.

Language

COLLIE98.7%Aut.

Long Context

OpenAI-MRCR: 2 needle 128k18.7%Aut.
ComplexFuncBench17.6%Aut.

Math

MATH97.9%Aut.
MGSM92.0%Aut.
AIME 202487.3%Aut.
FrontierMath9.2%Aut.

Reasoning

Graphwalks parents <128k58.3%Aut.
Graphwalks BFS <128k51.0%Aut.

Indices d'évaluation AA

Intelligence Index
25.9
Coding Index
17.9
Math 500
1.0
Mmlu Pro
0.8
Aime
0.8
Gpqa
0.7
Livecodebench
0.7
Scicode
0.4
Tau2
0.3
Hle
0.1
Terminalbench Hard
0.1

Scores par catégorie LLM Stats

Writing
100
Finance
90
Healthcare
90
Instruction Following
90
Language
90
Legal
90
Biology
80
Chemistry
80
Math
80
Physics
80
General
70
Structured Output
60
Reasoning
60
Spatial Reasoning
50
Communication
50
Frontend Development
50
Tool Calling
40
Code
40
Long Context
20
Factuality
10

Tarification

Prix d'entrée$1.1 / 1M tokens
Prix de sortie$4.4 / 1M tokens
Prix mixte (3:1)$1.925 / 1M tokens

Vitesse

Tokens/sec135.1 tokens/s
Délai du premier token10.07s
Temps de réponse10.07s

Fournisseurs disponibles

(Unités internes LS)

Aucune donnée de fournisseur disponible

Sources externes