Skip to main content

GPT-4o (May '24)

OpenAIGPTProprietary

Description

GPT-4o ('o' for 'omni') is a multimodal AI model that accepts text, audio, image, and video inputs, and generates text, audio, and image outputs. It matches GPT-4 Turbo performance on text and code, with improvements in non-English languages, vision, and audio understanding.

Release Date
2024-05-13
Parameters
—
Context Length
128K
Modalities
image, pdf, text

Capability Radar

80
general
90
coding
80
reasoning
43
scienceest.
83
agents
85
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU88.7%SR

Language

MMLU-Pro72.6%SR

Math

MGSM90.5%SR
MATH76.6%SR
MathVista63.8%SR

Reasoning

HumanEvalOpenAI (2021)90.2%SR
DROP83.4%SR
GPQANYU + Cohere + Anthropic (2023)53.6%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Code
90
Language
80
Legal
80
Math
80
Reasoning
80
Finance
80
General
80
Healthcare
80
Multimodal
60
Vision
60
Physics
50
Biology
50
Chemistry
50

Pricing

Input Price$5 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$4.375 / 1M tokens
Cache Read Price$1.25 / 1M tokens

Speed

Tokens/sec175.1
Time to First Token1.83s
Time to Answer1.83s

Provider Price Ranking

Provider Price Ranking

10 providers

Cheapest: OpenAIMost Expensive: Cortecs
ProviderInputOutput
1OpenAICheapest
$2.5
$10
2Azure
$2.5
$10
3302.AI
$2.5
$10
4Abacus
$2.5
$10
5Helicone
$2.5
$10
6FrogBot
$2.5
$10
7AIHubMix
$2.5
$10
8Azure Cognitive Services
$2.5
$10
9DevPass (LLM Gateway)
$2.5
$10
10Cortecs
$2.659
$10.635

Compare pricing across different API providers for this model.

External Sources