Skip to main content

Claude 3 Sonnet

AnthropicClaudeProprietary

Description

Claude 3 Sonnet strikes the ideal balance between intelligence and speed—particularly for enterprise workloads. It delivers strong performance at a lower cost compared to its peers, and is engineered for high endurance in large-scale AI deployments.

Release Date
2024-03-04
Parameters
—
Context Length
—
Modalities
image, text

Capability Radar

21
general
18
coding
23
reasoning
29
science
21
agents
80
multimodal

Rankings

Domain#RankScoreSource
Code Ranking523
19.0
AA
General Ranking545
24.0
AA
Science576
20.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU79.0%SR

Language

MMLU-Pro56.8%SR

Math

GSM8k92.3%SR
MGSM83.5%SR
MATH43.1%SR

Reasoning

ARC-C93.2%SR
HellaSwagAI2 (2019)89.0%SR
BIG-Bench Hard82.9%SR
DROP78.9%SR
HumanEvalOpenAI (2021)73.0%SR
GPQANYU + Cohere + Anthropic (2023)40.4%SR

AA Evaluation Indices

(Artificial Analysis)
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
57.9
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
41.4
Gpqa(NYU + Cohere + Anthropic (2023))
40.0
Livecodebench(UC Berkeley + MIT + Cornell (2024))
17.5
Intelligence Index(Artificial Analysis)
5.9
Aime(MAA (Mathematical Association of America))
4.7
Hle(Center for AI Safety + Scale AI (2025))
3.6

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
70
Legal
70
Math
70
Reasoning
70
Finance
70
General
70
Healthcare
70
Code
70
Physics
40
Biology
40
Chemistry
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources