Skip to main content

GPT-4.1 mini

OpenAIGPTProprietary

Description

GPT-4.1 mini provides a balance between intelligence, speed, and cost. It's a significant leap in small model performance, even beating GPT-4o in many benchmarks while reducing latency and cost.

Release Date
2025-04-14
Parameters
Context Length
1.0M
Modalities
image, pdf, text

Capability Radar

33
general
47
coding
54
reasoning
45
scienceest.
50
agents
85
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking244
40.0
AA
General Ranking222
46.0
AA
Math Reasoning160
56.0
AA
Multimodal Ranking54
75.0
LS
Reasoning65
62.0
LS
Science215
47.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA65.0%SR

Code

Aider-Polyglot34.7%SR
Aider-Polyglot Edit31.6%SR
SWE-Bench Verified23.6%SR

Communication

Multi-IF67.0%SR
TAU-bench Retail55.8%SR
TAU-bench Airline36.0%SR
Multi-Challenge35.8%SR

Finance

MMLU87.5%SR

General

IFEval84.1%SR
MMMLU78.5%SR
MMMU72.7%SR
Internal API instruction following (hard)45.1%SR

Language

COLLIE54.6%SR

Long Context

ComplexFuncBench49.3%SR
OpenAI-MRCR: 2 needle 128k47.2%SR
OpenAI-MRCR: 2 needle 1M33.3%SR
Graphwalks BFS >128k15.0%SR
Graphwalks parents >128k11.0%SR

Math

MathVista73.1%SR
AIME 202449.6%SR
AIME 202540.2%SR
HMMT 202535.0%SR
Humanity's Last Exam3.7%SR

Multimodal

CharXiv-D88.4%SR
CharXiv-R56.8%SR

Reasoning

Graphwalks BFS <128k61.7%SR
Graphwalks parents <128k60.5%SR

AA Evaluation Indices

Math Index
46.3
Intelligence Index
16.3
Math 500
0.9
Mmlu Pro
0.8
Gpqa
0.7
Tau2
0.5
Livecodebench
0.5
Aime 25
0.5
Aime
0.4
Lcr
0.4
Scicode
0.4
Ifbench
0.4
Terminalbench Hard
0.1
Hle
0.0

LLM Stats Category Scores

Legal
90
Finance
90
Instruction Following
80
Healthcare
80
Language
70
Multimodal
70
Physics
70
Structured Output
70
Biology
70
Chemistry
70
General
60
Vision
60
Math
50
Reasoning
50
Communication
50
Tool Calling
50
Writing
50
Spatial Reasoning
40
Long Context
30
Code
30
Frontend Development
20

Pricing

Input Price$0.4 / 1M tokens
Output Price$1.6 / 1M tokens
Blended Price (3:1)$0.7 / 1M tokens
Cache Read Price$0.1 / 1M tokens

Speed

Tokens/sec98.8
Time to First Token0.52s
Time to Answer0.52s

Provider Price Ranking

Provider Price Ranking

17 providers

Cheapest: OpenAIMost Expensive: Merge Gateway
ProviderInputOutput
1OpenAICheapest
$0
$0
2Poe
$0.36
$1.4
3Helicone
$0.4
$1.6
4302.AI
$0.4
$1.6
5NanoGPT
$0.4
$1.6
6Abacus
$0.4
$1.6
7OpenRouter
$0.4
$1.6
8Kilo Gateway
$0.4
$1.6
9SAP AI Core
$0.4
$1.6
10Azure Cognitive Services
$0.4
$1.6
11Requesty
$0.4
$1.6
12Vercel AI Gateway
$0.4
$1.6
13LLM Gateway
$0.4
$1.6
14Azure
$0.4
$1.6
15NEAR AI Cloud
$0.4
$1.6
16OrcaRouter
$0.4
$1.6
17Merge Gateway
$0.4
$1.6

Compare pricing across different API providers for this model.

External Sources