Skip to main content

GPT-4o mini

OpenAIGPTProprietary

Description

GPT-4o mini is OpenAI's latest cost-efficient small model, designed to make AI intelligence more accessible and affordable. It excels in textual intelligence and multimodal reasoning, outperforming previous models like GPT-3.5 Turbo. With a context window of 128K tokens and support for text and vision, it offers low-cost, real-time applications such as customer support chatbots. Priced at 15 cents per million input tokens and 60 cents per million output tokens, it is significantly cheaper than its predecessors. Safety is prioritized with built-in measures and improved resistance to security threats.

Release Date
2024-07-18
Parameters
Context Length
128K
Modalities
image, pdf, text

Capability Radar

24
general
23
coding
26
reasoning
28
scienceest.
25
agents
85
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking327
25.0
AA
General Ranking382
29.0
AA
Math Reasoning277
27.0
AA
Science398
27.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA40.2%SR

Code

HumanEval87.2%SR
SWE-Bench Verified8.7%SR

Finance

MMLU82.0%SR

General

MMMU59.4%SR

Math

MGSM87.0%SR
DROP79.7%SR
MATH70.2%SR
MathVista56.7%SR

AA Evaluation Indices

Math Index
14.7
Intelligence Index
6.9
Math 500
0.8
Mmlu Pro
0.6
Gpqa
0.4
Ifbench
0.3
Livecodebench
0.2
Scicode
0.2
Aime 25
0.1
Aime
0.1
Hle
0.0

LLM Stats Category Scores

Language
80
Legal
80
Math
80
Finance
80
Healthcare
70
Multimodal
60
Reasoning
60
General
60
Vision
60
Code
50
Physics
40
Biology
40
Chemistry
40
Frontend Development
10

Pricing

Input Price$0.15 / 1M tokens
Output Price$0.6 / 1M tokens
Blended Price (3:1)$0.262 / 1M tokens
Cache Read Price$0.075 / 1M tokens

Speed

Tokens/sec83.8
Time to First Token0.57s
Time to Answer0.57s

Provider Price Ranking

Provider Price Ranking

17 providers

Cheapest: PoeMost Expensive: Venice AI
ProviderInputOutput
1PoeCheapest
$0.14
$0.54
2NanoGPT
$0.1496
$0.595
3OpenAIPRIMARY
$0.15
$0.6
4Abacus
$0.15
$0.6
5OpenRouter
$0.15
$0.6
6Kilo Gateway
$0.15
$0.6
7Cloudflare AI Gateway
$0.15
$0.6
8Helicone
$0.15
$0.6
9Azure Cognitive Services
$0.15
$0.6
10Requesty
$0.15
$0.6
11DigitalOcean
$0.15
$0.6
12Vercel AI Gateway
$0.15
$0.6
13LLM Gateway
$0.15
$0.6
14Azure
$0.15
$0.6
15OrcaRouter
$0.15
$0.6
16Merge Gateway
$0.15
$0.6
17Venice AI
$0.1875
$0.75

Compare pricing across different API providers for this model.

External Sources