GPT-4o mini
OpenAIGPTProprietary
Description
GPT-4o mini is OpenAI's latest cost-efficient small model, designed to make AI intelligence more accessible and affordable. It excels in textual intelligence and multimodal reasoning, outperforming previous models like GPT-3.5 Turbo. With a context window of 128K tokens and support for text and vision, it offers low-cost, real-time applications such as customer support chatbots. Priced at 15 cents per million input tokens and 60 cents per million output tokens, it is significantly cheaper than its predecessors. Safety is prioritized with built-in measures and improved resistance to security threats.
Release Date
2024-07-18
Parameters
—
Context Length
128K
Modalities
file, image, text
Capability Radar
27
general
23
coding
26
reasoning
28
scienceest.
0
agents
85
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 302 | 25.0 | AA |
| General Ranking | 360 | 31.0 | AA |
| Math Reasoning | 277 | 27.0 | AA |
| Science | 374 | 28.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
40.2%SR
Code
HumanEval
87.2%SR
SWE-Bench Verified
8.7%SR
Finance
MMLU
82.0%SR
General
MMMU
59.4%SR
Math
MGSM
87.0%SR
DROP
79.7%SR
MATH
70.2%SR
MathVista
56.7%SR
AA Evaluation Indices
Math Index14.7
Intelligence Index12.6
Math 5000.8
Mmlu Pro0.6
Gpqa0.4
Ifbench0.3
Livecodebench0.2
Scicode0.2
Aime 250.1
Aime0.1
Hle0.0
LLM Stats Category Scores
Finance80
Language80
Legal80
Math80
Healthcare70
Vision60
General60
Multimodal60
Reasoning60
Code50
Biology40
Chemistry40
Physics40
Frontend Development10
Pricing
Input Price$0.15 / 1M tokens
Output Price$0.6 / 1M tokens
Blended Price (3:1)$0.262 / 1M tokens
Speed
Tokens/sec59.8 tokens/s
Time to First Token0.62s
Time to Answer0.62s
Available Providers
(LS internal units)No provider data available