GPT-3.5 Turbo
OpenAIProprietary
Description
The latest GPT-3.5 Turbo model with higher accuracy at responding in requested formats and a fix for a bug which caused a text encoding issue for non-English language function calls.
Release Date
2022-11-30
Parameters
—
Context Length
16K
Modalities
text
Capability Radar
22
general
11
coding
38
reasoning
30
scienceest.
0
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 361 | 18.0 | AA |
| General Ranking | 432 | 21.0 | AA |
| Math Reasoning | 220 | 41.0 | AA |
| Science | 393 | 24.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
30.8%SR
Code
HumanEval
68.0%SR
Finance
MMLU
69.8%SR
General
MMMU
0.0%SR
Math
DROP
70.2%SR
MGSM
56.3%SR
MATH
43.1%SR
MathVista
0.0%SR
AA Evaluation Indices
Coding Index10.7
Intelligence Index9.0
Mmlu Pro0.5
Math 5000.4
Gpqa0.3
LLM Stats Category Scores
Code70
Finance70
Language70
Legal70
Math50
Reasoning50
Biology30
Chemistry30
General30
Healthcare30
Physics30
Vision0
Multimodal0
Pricing
Input Price$0.5 / 1M tokens
Output Price$1.5 / 1M tokens
Blended Price (3:1)$0.75 / 1M tokens
Speed
Tokens/sec75.6 tokens/s
Time to First Token0.47s
Time to Answer0.47s
Available Providers
(LS internal units)| Provider | Input Price | Output Price |
|---|---|---|
| Azure | 500K | 1.5M |
| OpenAI | 500K | 1.5M |