Skip to main content
AITier

Claude 3.5 Sonnet

AnthropicClaudeProprietary

Description

Claude 3.5 Sonnet is a powerful AI model. It excels in graduate-level reasoning, undergraduate-level knowledge, and coding proficiency, with improved understanding of nuance, humor, and complex instructions.

Release Date
2024-06-21
Parameters
—
Context Length
—
Modalities
image, text

Capability Radar

80
general
90
coding
90
reasoning
51
scienceest.
0
agents
70
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

Biology

GPQA59.4%SR

Code

HumanEval92.0%SR

Finance

MMLU90.4%SR
MMLU-Pro76.1%SR

Language

BIG-Bench Hard93.1%SR

Math

GSM8k96.4%SR
MGSM91.6%SR
DROP87.1%SR
MATH71.1%SR

AA Evaluation Indices

No AA evaluation data available

LLM Stats Category Scores

Code
90
Language
90
Math
90
Finance
80
General
80
Healthcare
80
Legal
80
Reasoning
80
Biology
60
Chemistry
60
Physics
60

Pricing

No pricing data available

Speed

No speed data available

Available Providers

(LS internal units)

No provider data available

External Sources

LLM Stats