Skip to main content
AITier

GPT-4.1 mini

OpenAIGPTProprietary

Description

GPT-4.1 mini provides a balance between intelligence, speed, and cost. It's a significant leap in small model performance, even beating GPT-4o in many benchmarks while reducing latency and cost.

Release Date
2025-04-14
Parameters
—
Context Length
1.0M
Modalities
file, image, text

Capability Radar

37
general
31
coding
54
reasoning
45
scienceest.
50
agents
85
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking229
37.0
AA
General Ranking207
49.0
AA
Math Reasoning161
56.0
AA
Multimodal Ranking49
75.0
LS
Reasoning61
62.0
LS
Science196
48.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA65.0%SR

Code

Aider-Polyglot34.7%SR
Aider-Polyglot Edit31.6%SR
SWE-Bench Verified23.6%SR

Communication

Multi-IF67.0%SR
TAU-bench Retail55.8%SR
TAU-bench Airline36.0%SR
Multi-Challenge35.8%SR

Finance

MMLU87.5%SR

General

IFEval84.1%SR
MMMLU78.5%SR
MMMU72.7%SR
Internal API instruction following (hard)45.1%SR

Language

COLLIE54.6%SR

Long Context

ComplexFuncBench49.3%SR
OpenAI-MRCR: 2 needle 128k47.2%SR
OpenAI-MRCR: 2 needle 1M33.3%SR
Graphwalks BFS >128k15.0%SR
Graphwalks parents >128k11.0%SR

Math

MathVista73.1%SR
AIME 202449.6%SR
AIME 202540.2%SR
HMMT 202535.0%SR
Humanity's Last Exam3.7%SR

Multimodal

CharXiv-D88.4%SR
CharXiv-R56.8%SR

Reasoning

Graphwalks BFS <128k61.7%SR
Graphwalks parents <128k60.5%SR

AA Evaluation Indices

Math Index
46.3
Intelligence Index
22.9
Coding Index
18.5
Math 500
0.9
Mmlu Pro
0.8
Gpqa
0.7
Tau2
0.5
Livecodebench
0.5
Aime 25
0.5
Aime
0.4
Lcr
0.4
Scicode
0.4
Ifbench
0.4
Terminalbench Hard
0.1
Hle
0.0

LLM Stats Category Scores

Finance
90
Legal
90
Healthcare
80
Instruction Following
80
Structured Output
70
Biology
70
Chemistry
70
Language
70
Multimodal
70
Physics
70
Vision
60
General
60
Tool Calling
50
Writing
50
Communication
50
Math
50
Reasoning
50
Spatial Reasoning
40
Code
30
Long Context
30
Frontend Development
20

Pricing

Input Price$0.4 / 1M tokens
Output Price$1.6 / 1M tokens
Blended Price (3:1)$0.7 / 1M tokens

Speed

Tokens/sec78.8 tokens/s
Time to First Token0.52s
Time to Answer0.52s

Available Providers

(LS internal units)
ProviderInput PriceOutput Price
OpenAI400K1.6M

External Sources

LLM Stats