Skip to main content

GPT-4.1

OpenAIGPTProprietary

Description

GPT-4.1 is OpenAI's latest and most advanced flagship model, significantly improving upon GPT-4 Turbo in performance across benchmarks, speed, and cost-effectiveness.

Release Date
2025-04-14
Parameters
—
Context Length
1.0M
Modalities
image, pdf, text

Capability Radar

32
general
46
coding
49
reasoning
47
science
60
agents
85
multimodal

Rankings

Domain#RankScoreSource
Code Ranking308
49.0
AA
General Ranking302
43.0
AA
Multimodal Ranking66
54.0
LS
Science411
36.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)87.4%SR
Multi-IF70.8%SR
TAU-bench Retail68.0%SR
Multi-Challenge38.3%SR

General

MMLU90.2%SR
Aider-Polyglot Edit52.9%SR
Aider-Polyglot51.6%SR
Internal API instruction following (hard)49.1%SR

Language

MMMLU87.3%SR
COLLIE65.8%SR

Long Context

ComplexFuncBench65.5%SR
OpenAI-MRCR: 2 needle 128k57.2%SR
OpenAI-MRCR: 2 needle 1M46.3%SR

Math

MathVista72.2%SR
AIME 202448.1%SR
AIME 202546.4%SR
HMMT 202528.9%SR

Multimodal

MMMU74.8%SR

Reasoning

CharXiv-D87.9%SR
GPQANYU + Cohere + Anthropic (2023)66.3%SR
Graphwalks BFS <128k61.7%SR
Graphwalks parents <128k58.0%SR
CharXiv-R56.7%SR
SWE-Bench Verified54.6%SR
TAU-bench Airline49.4%SR
Graphwalks parents >128k25.0%SR
Graphwalks BFS >128k19.0%SR
Humanity's Last Exam5.4%SR

Vision

Video-MME (long, no subtitles)72.0%SR

AA Evaluation Indices

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
91.3
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
80.6
Lcr(Artificial Analysis)
68.3
Gpqa(NYU + Cohere + Anthropic (2023))
66.6
Tau2(Sierra + U Toronto + Vector Institute (2025))
47.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))
45.7
Aime(MAA (Mathematical Association of America))
43.7
Ifbench(Google Research (2023))
43.0
Math Index(Artificial Analysis)
34.7
Aime 25(MAA (Mathematical Association of America))
34.7
Terminalbench Hard(Stanford × Laude Institute (2026))
13.6
Intelligence Index(Artificial Analysis)
12.7
Hle(Center for AI Safety + Scale AI (2025))
4.2

LLM Stats Category Scores

(LLM Stats (zeroeval))
Legal
90
Finance
90
Instruction Following
80
Language
80
Healthcare
80
Chat
70
Multimodal
70
Physics
70
Structured Output
70
Biology
70
Chemistry
70
Writing
70
Reasoning
60
General
60
Communication
60
Tool Calling
60
Vision
60
Math
50
Frontend Development
50
Code
50
Long Context
40
Spatial Reasoning
40

Pricing

Input Price$2 / 1M tokens
Output Price$8 / 1M tokens
Blended Price (3:1)$3.5 / 1M tokens
Cache Read Price$0.5 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

24 providers

Cheapest: OpenAIMost Expensive: Cortecs
ProviderInputOutput
1OpenAICheapest
$0
$0.00001
2Ofox
$1.6
$6.4
3Poe
$1.8
$7.2
4302.AI
$2
$8
5NanoGPT
$2
$8
6Abacus
$2
$8
7OpenRouter
$2
$8
8Kilo Gateway
$2
$8
9SAP AI Core
$2
$8
10Cloudflare AI Gateway
$2
$8
11Helicone
$2
$8
12Azure Cognitive Services
$2
$8
13Vercel AI Gateway
$2
$8
14DevPass (LLM Gateway)
$2
$8
15Azure
$2
$8
16FastRouter
$2
$8
17NEAR AI Cloud
$2
$8
18OrcaRouter
$2
$8
19Merge Gateway
$2
$8
20Pioneer
$2
$8
21Impossibl
$2
$8
22Eden AI
$2
$8
23LLM Gateway
$2
$8
24Cortecs
$2.192
$8.769

Compare pricing across different API providers for this model.

External Sources