Skip to main content

GPT-4

OpenAIGPTProprietary

Description

GPT-4 is a large multimodal model capable of processing both image and text inputs and generating human-like text outputs. It demonstrates human-level performance on various professional and academic benchmarks.

Release Date
2023-03-14
Parameters
Context Length
8K
Modalities
image, text

Capability Radar

7
general
13
coding
70
reasoning
34
scienceest.
53
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking395
16.0
AA
General Ranking502
10.0
AA
Reasoning3
95.0
LS

Benchmark Scores (LLM Stats)

Biology

GPQA35.7%SR

Code

HumanEval67.0%SR

Finance

MMLU86.4%SR

General

AI2 Reasoning Challenge (ARC)96.3%SR
LSAT88.0%SR

Language

Winogrande87.5%SR

Legal

Uniform Bar Exam90.0%SR

Math

SAT Math89.0%SR
DROP80.9%SR
MGSM74.5%SR
MATH42.0%SR

Reasoning

HellaSwag95.3%SR

AA Evaluation Indices

Coding Index
13.1
Intelligence Index
7.0

LLM Stats Category Scores

Language
90
Legal
90
Finance
90
Healthcare
90
Math
70
Reasoning
70
Code
70
General
60
Physics
40
Biology
40
Chemistry
40

Pricing

Input Price$30 / 1M tokens
Output Price$60 / 1M tokens
Blended Price (3:1)$37.5 / 1M tokens

Speed

Tokens/sec41.4
Time to First Token0.93s
Time to Answer0.93s

Provider Price Ranking

Provider Price Ranking

9 providers

Cheapest: NanoGPTMost Expensive: Azure
ProviderInputOutput
1NanoGPTCheapest
$9.996
$30.005
2OpenAIPRIMARY
$30
$60
3OpenRouter
$30
$60
4Kilo Gateway
$30
$60
5Cloudflare AI Gateway
$30
$60
6LLM Gateway
$30
$60
7OrcaRouter
$30
$60
8Azure Cognitive Services
$60
$120
9Azure
$60
$120

Compare pricing across different API providers for this model.

External Sources