Claude 3.5 Sonnet
AnthropicClaudeProprietary
Description
Claude 3.5 Sonnet is a powerful AI model. It excels in graduate-level reasoning, undergraduate-level knowledge, and coding proficiency, with improved understanding of nuance, humor, and complex instructions.
Release Date
2024-06-21
Parameters
—
Context Length
—
Modalities
image, text
Capability Radar
80
general
90
coding
90
reasoning
51
scienceest.
90
agents
70
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
59.4%SR
Code
HumanEvalOpenAI (2021)
92.0%SR
Finance
MMLU
90.4%SR
MMLU-Pro
76.1%SR
Language
BIG-Bench Hard
93.1%SR
Math
GSM8k
96.4%SR
MGSM
91.6%SR
DROP
87.1%SR
MATH
71.1%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Math90
Language90
Code90
Legal80
Reasoning80
Finance80
General80
Healthcare80
Physics60
Biology60
Chemistry60
Pricing
No pricing data available
Speed
No speed data available
Provider Price Ranking
No provider data available