GPT-4
OpenAIGPTProprietary
Description
GPT-4 is a large multimodal model capable of processing both image and text inputs and generating human-like text outputs. It demonstrates human-level performance on various professional and academic benchmarks.
Release Date
2023-03-14
Parameters
—
Context Length
8K
Modalities
image, text
Capability Radar
24
general
13
coding
48
reasoning
35
science
37
agents
80
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 450 | 17.0 | AA |
| General Ranking | 458 | 27.0 | AA |
| Science | 442 | 29.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
35.7%SR
Code
HumanEvalOpenAI (2021)
67.0%SR
Finance
MMLU
86.4%SR
General
AI2 Reasoning Challenge (ARC)
96.3%SR
LSAT
88.0%SR
Language
Winogrande
87.5%SR
Legal
Uniform Bar Exam
90.0%SR
Math
SAT Math
89.0%SR
DROP
80.9%SR
MGSM
74.5%SR
MATH
42.0%SR
Reasoning
HellaSwagAI2 (2019)
95.3%SR
AA Evaluation Indices
(Artificial Analysis)Coding Index(Artificial Analysis)13.1
Intelligence Index(Artificial Analysis)6.8
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.6
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.6
Gpqa(NYU + Cohere + Anthropic (2023))0.3
Ifbench(Google Research (2023))0.3
LLM Stats Category Scores
(LLM Stats (zeroeval))Legal90
Language90
Finance90
Healthcare90
Math70
Reasoning70
General70
Code70
Physics40
Biology40
Chemistry40
Pricing
Input Price$30 / 1M tokens
Output Price$60 / 1M tokens
Blended Price (3:1)$37.5 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
7 providers
Cheapest: OpenAIMost Expensive: Merge Gateway
ProviderInputOutput
1OpenAIPRIMARY
$30
$60
2OpenRouter
$30
$60
3Kilo Gateway
$30
$60
4Cloudflare AI Gateway
$30
$60
5LLM Gateway
$30
$60
6OrcaRouter
$30
$60
7Merge Gateway
$30
$60
Compare pricing across different API providers for this model.