Claude 3.5 Sonnet (Oct '24)
AnthropicClaude
Release Date
2024-10-22
Parameters
—
Context Length
—
Modalities
—
Capability Radar
28
general
33
coding
43
reasoning
43
science
40
agents
80
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 369 | 38.0 | AA |
| General Ranking | 403 | 34.0 | AA |
| Science | 455 | 31.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))No benchmark data available
AA Evaluation Indices
(Artificial Analysis)Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))77.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))77.1
Gpqa(NYU + Cohere + Anthropic (2023))59.9
Livecodebench(UC Berkeley + MIT + Cornell (2024))38.1
Coding Index(Artificial Analysis)30.2
Aime(MAA (Mathematical Association of America))15.7
Intelligence Index(Artificial Analysis)7.9
Hle(Center for AI Safety + Scale AI (2025))3.7
LLM Stats Category Scores
(LLM Stats (zeroeval))No category score data available
Pricing
Input Price$3 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$6 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
1 providers
ProviderInputOutput
1AnthropicPRIMARY
$3
$15
Compare pricing across different API providers for this model.