Claude 3.5 Sonnet (Oct '24)
AnthropicClaude
Description
Claude 3.5 Sonnet is a powerful AI model. It excels in graduate-level reasoning, undergraduate-level knowledge, and coding proficiency, with improved understanding of nuance, humor, and complex instructions.
Release Date
2024-10-22
Parameters
—
Context Length
200K
Modalities
image, pdf, text
Capability Radar
29
general
34
coding
43
reasoning
41
scienceest.
60
agents
100
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 240 | 40.0 | AA |
| General Ranking | 284 | 38.0 | AA |
| Math Reasoning | 197 | 46.0 | AA |
| Science | 270 | 42.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
59.4%SR
Code
HumanEval
92.0%SR
Finance
MMLU
90.4%SR
MMLU-Pro
76.1%SR
Language
BIG-Bench Hard
93.1%SR
Math
GSM8k
96.4%SR
MGSM
91.6%SR
DROP
87.1%SR
MATH
71.1%SR
AA Evaluation Indices
Coding Index30.2
Intelligence Index9.9
Mmlu Pro0.8
Math 5000.8
Gpqa0.6
Livecodebench0.4
Scicode0.4
Aime0.2
Hle0.0
LLM Stats Category Scores
Language90
Math90
Code90
Legal80
Reasoning80
Finance80
General80
Healthcare80
Physics60
Biology60
Chemistry60
Pricing
Input Price$3 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$6 / 1M tokens
Cache Read Price$0.3 / 1M tokens
Cache Write Price$3.75 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
5 providers
Cheapest: AnthropicMost Expensive: DigitalOcean
ProviderInputOutput
1AnthropicPRIMARY
$3
$15
2SAP AI Core
$3
$15
3Cloudflare AI Gateway
$3
$15
4Helicone
$3
$15
5DigitalOcean
$3
$15
Compare pricing across different API providers for this model.