Claude 3 Sonnet
AnthropicClaudeProprietary
Description
Claude 3 Sonnet strikes the ideal balance between intelligence and speed—particularly for enterprise workloads. It delivers strong performance at a lower cost compared to its peers, and is engineered for high endurance in large-scale AI deployments.
Release Date
2024-03-04
Parameters
—
Context Length
—
Modalities
image, text
Capability Radar
24
general
19
coding
23
reasoning
27
scienceest.
0
agents
80
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 354 | 19.0 | AA |
| General Ranking | 389 | 27.0 | AA |
| Math Reasoning | 300 | 22.0 | AA |
| Reasoning | 12 | 89.0 | LS |
| Science | 380 | 27.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
40.4%SR
Code
HumanEval
73.0%SR
Finance
MMLU
79.0%SR
MMLU-Pro
56.8%SR
General
ARC-C
93.2%SR
Language
BIG-Bench Hard
82.9%SR
Math
GSM8k
92.3%SR
MGSM
83.5%SR
DROP
78.9%SR
MATH
43.1%SR
Reasoning
HellaSwag
89.0%SR
AA Evaluation Indices
Intelligence Index10.3
Mmlu Pro0.6
Math 5000.4
Gpqa0.4
Scicode0.2
Livecodebench0.2
Aime0.0
Hle0.0
LLM Stats Category Scores
Code70
Finance70
General70
Healthcare70
Language70
Legal70
Math70
Reasoning70
Biology40
Chemistry40
Physics40
Pricing
Input Price$3 / 1M tokens
Output Price$15 / 1M tokens
Blended Price (3:1)$6 / 1M tokens
Speed
Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s
Available Providers
(LS internal units)No provider data available