GPT-4o (May '24)
OpenAIGPTProprietary
Description
GPT-4o ('o' for 'omni') is a multimodal AI model that accepts text, audio, image, and video inputs, and generates text, audio, and image outputs. It matches GPT-4 Turbo performance on text and code, with improvements in non-English languages, vision, and audio understanding.
Release Date
2024-05-13
Parameters
—
Context Length
128K
Modalities
image, pdf, text
Capability Radar
27
general
28
coding
40
reasoning
35
science
36
agents
85
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 330 | 33.0 | AA |
| General Ranking | 369 | 35.0 | AA |
| Science | 394 | 34.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
53.6%SR
Code
HumanEvalOpenAI (2021)
90.2%SR
Finance
MMLU
88.7%SR
MMLU-Pro
72.6%SR
Math
MGSM
90.5%SR
DROP
83.4%SR
MATH
76.6%SR
MathVista
63.8%SR
AA Evaluation Indices
(Artificial Analysis)Coding Index(Artificial Analysis)24.2
Intelligence Index(Artificial Analysis)8.4
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.8
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.5
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.3
Scicode(UIUC + Argonne National Lab (2024))0.3
Aime(MAA (Mathematical Association of America))0.1
Hle(Center for AI Safety + Scale AI (2025))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Code90
Legal80
Math80
Reasoning80
Language80
Finance80
General80
Healthcare80
Multimodal60
Vision60
Physics50
Biology50
Chemistry50
Pricing
Input Price$5 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$7.5 / 1M tokens
Cache Read Price$1.25 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
2 providers
Cheapest: OpenAIMost Expensive: Azure
ProviderInputOutput
1OpenAICheapest
$0
$0.00001
2Azure
$0
$0.00001
Compare pricing across different API providers for this model.