GPT-4
OpenAIGPTProprietary
Description
GPT-4 is a large multimodal model capable of processing both image and text inputs and generating human-like text outputs. It demonstrates human-level performance on various professional and academic benchmarks.
Release Date
2023-03-14
Parameters
—
Context Length
8K
Modalities
image, text
Capability Radar
24
general
13
coding
48
reasoning
35
science
37
agents
80
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 540 | 16.0 | AA |
| General Ranking | 526 | 26.0 | AA |
| Science | 487 | 29.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
86.4%SR
Legal
Uniform Bar Exam
90.0%SR
Math
SAT Math
89.0%SR
MGSM
74.5%SR
MATH
42.0%SR
Reasoning
AI2 Reasoning Challenge (ARC)
96.3%SR
HellaSwagAI2 (2019)
95.3%SR
LSAT
88.0%SR
Winogrande
87.5%SR
DROP
80.9%SR
HumanEvalOpenAI (2021)
67.0%SR
GPQANYU + Cohere + Anthropic (2023)
35.7%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))56.8
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))56.2
Gpqa(NYU + Cohere + Anthropic (2023))34.9
Ifbench(Google Research (2023))33.2
Coding Index(Artificial Analysis)13.1
Intelligence Index(Artificial Analysis)6.7
LLM Stats Category Scores
(LLM Stats (zeroeval))Language90
Legal90
Finance90
Healthcare90
Math70
Reasoning70
General70
Code70
Physics40
Biology40
Chemistry40
Pricing
Input Price$30 / 1M tokens
Output Price$60 / 1M tokens
Blended Price (3:1)$37.5 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
8 providers
Cheapest: OpenAIMost Expensive: LLM Gateway
ProviderInputOutput
1OpenAIPRIMARY
$30
$60
2OpenRouter
$30
$60
3Kilo Gateway
$30
$60
4DevPass (LLM Gateway)
$30
$60
5OrcaRouter
$30
$60
6Merge Gateway
$30
$60
7Eden AI
$30
$60
8LLM Gateway
$30
$60
Compare pricing across different API providers for this model.