GPT-4o (March 2025, chatgpt-4o-latest)
OpenAIGPT
Release Date
2025-03-27
Parameters
—
Context Length
400K
Modalities
image, text
Capability Radar
32
general
41
coding
41
reasoning
43
scienceest.
80
agents
90
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 210 | 46.0 | AA |
| General Ranking | 250 | 42.0 | AA |
| Math Reasoning | 221 | 40.0 | AA |
| Science | 240 | 45.0 | AA |
Benchmark Scores (LLM Stats)
Agents
BrowseComp
54.9%SR
Biology
GPQA
85.7%SR
Code
SWE-Lancer (IC-Diamond subset)
100.0%SR
HumanEval
93.4%SR
Aider-Polyglot
88.0%SR
SWE-Bench Verified
74.9%SR
Communication
Tau2 Telecom
96.7%SR
Tau2 Retail
81.1%SR
Multi-Challenge
69.6%SR
Tau2 Airline
62.6%SR
Finance
MMLU
92.5%SR
General
MMMU
84.2%SR
MMMU-Pro
78.4%SR
Internal API instruction following (hard)
64.0%SR
LongFact Objects
0.8%SR
LongFact Concepts
0.7%SR
Healthcare
VideoMMMU
84.6%SR
HealthBench Hard
1.6%SR
Language
COLLIE
99.0%SR
Long Context
OpenAI-MRCR: 2 needle 128k
95.2%SR
OpenAI-MRCR: 2 needle 256k
86.8%SR
Math
AIME 2025
94.6%SR
HMMT 2025
93.3%SR
MATH
84.7%SR
FrontierMath
26.3%SR
Humanity's Last Exam
24.8%SR
Multimodal
VideoMME w sub.
86.7%SR
CharXiv-R
81.1%SR
Reasoning
BrowseComp Long Context 128k
90.0%SR
BrowseComp Long Context 256k
88.8%SR
Graphwalks BFS <128k
78.3%SR
Graphwalks parents <128k
73.3%SR
ERQA
65.7%SR
FActScore
1.0%SR
AA Evaluation Indices
Math Index25.7
Intelligence Index12.3
Math 5000.9
Mmlu Pro0.8
Gpqa0.7
Livecodebench0.4
Scicode0.4
Aime0.3
Aime 250.3
Hle0.1
LLM Stats Category Scores
Language100
Long Context100
Writing100
Legal90
Physics90
Finance90
Biology90
Chemistry90
Code90
Video90
Reasoning80
General80
Communication80
Tool Calling80
Math70
Multimodal70
Search70
Frontend Development70
Healthcare70
Vision70
Spatial Reasoning60
Structured Output60
Agents50
Robotics20
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.125 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available