GPT-4o (May '24)
OpenAIGPTProprietary
Description
GPT-4o ('o' for 'omni') is a multimodal AI model that accepts text, audio, image, and video inputs, and generates text, audio, and image outputs. It matches GPT-4 Turbo performance on text and code, with improvements in non-English languages, vision, and audio understanding.
Release Date
2024-05-13
Parameters
—
Context Length
128K
Modalities
image, pdf, text
Capability Radar
80
general
90
coding
80
reasoning
43
scienceest.
83
agents
85
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
88.7%SR
Language
MMLU-Pro
72.6%SR
Math
MGSM
90.5%SR
MATH
76.6%SR
MathVista
63.8%SR
Reasoning
HumanEvalOpenAI (2021)
90.2%SR
DROP
83.4%SR
GPQANYU + Cohere + Anthropic (2023)
53.6%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Code90
Language80
Legal80
Math80
Reasoning80
Finance80
General80
Healthcare80
Multimodal60
Vision60
Physics50
Biology50
Chemistry50
Pricing
Input Price$5 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$4.375 / 1M tokens
Cache Read Price$1.25 / 1M tokens
Speed
Tokens/sec175.1
Time to First Token1.83s
Time to Answer1.83s
Provider Price Ranking
Provider Price Ranking
10 providers
Cheapest: OpenAIMost Expensive: Cortecs
ProviderInputOutput
1OpenAICheapest
$2.5
$10
2Azure
$2.5
$10
3302.AI
$2.5
$10
4Abacus
$2.5
$10
5Helicone
$2.5
$10
6FrogBot
$2.5
$10
7AIHubMix
$2.5
$10
8Azure Cognitive Services
$2.5
$10
9DevPass (LLM Gateway)
$2.5
$10
10Cortecs
$2.659
$10.635
Compare pricing across different API providers for this model.