Skip to main content

GPT-3.5 Turbo

OpenAIProprietary

Description

The latest GPT-3.5 Turbo model with higher accuracy at responding in requested formats and a fix for a bug which caused a text encoding issue for non-English language function calls.

Release Date
2022-11-30
Parameters
Context Length
16K
Modalities
text

Capability Radar

18
general
11
coding
38
reasoning
30
science
30
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking464
14.0
AA
General Ranking513
19.0
AA
Science475
23.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)30.8%

Code

HumanEvalOpenAI (2021)68.0%

Finance

MMLU69.8%

General

MMMU0.0%

Math

DROP70.2%
MGSM56.3%
MATH43.1%
MathVista0.0%

AA Evaluation Indices

(Artificial Analysis)
Coding Index(Artificial Analysis)
10.7
Intelligence Index(Artificial Analysis)
3.2
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.5
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.4
Gpqa(NYU + Cohere + Anthropic (2023))
0.3

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
70
Legal
70
Finance
70
Code
70
Math
50
Reasoning
50
General
40
Physics
30
Healthcare
30
Biology
30
Chemistry
30
Multimodal
0
Vision
0

Pricing

Input Price$0.5 / 1M tokens
Output Price$1.5 / 1M tokens
Blended Price (3:1)$0.75 / 1M tokens
Cache Read PriceFree

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

12 providers

Cheapest: OpenAIMost Expensive: Kilo Gateway
ProviderInputOutput
1OpenAICheapest
$0
$0
2Azure
$0
$0
3Poe
$0.45
$1.4
4NanoGPT
$0.5
$1.5
5Cloudflare AI Gateway
$0.5
$1.5
6Vercel AI Gateway
$0.5
$1.5
7LLM Gateway
$0.5
$1.5
8OrcaRouter
$0.5
$1.5
9Merge Gateway
$0.5
$1.5
10Impossibl
$0.5
$1.5
11OpenRouter
$1
$2
12Kilo Gateway
$1
$2

Compare pricing across different API providers for this model.

External Sources