Skip to main content

Claude 3.5 Haiku

AnthropicClaudeProprietary

Description

Claude 3.5 Haiku is Anthropic's fastest model, delivering advanced coding, tool use, and reasoning capabilities at an accessible price. It excels at user-facing products, specialized sub-agent tasks, and generating personalized experiences from large data volumes. The model is particularly well-suited for code completions, interactive chatbots, data extraction, and real-time content moderation.

Release Date
2024-10-22
Parameters
—
Context Length
—
Modalities
text

Capability Radar

60
general
60
coding
80
reasoning
34
scienceest.
40
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

TAU-bench Retail51.0%SR

Language

MMLU-Pro65.0%SR

Math

MGSM85.6%SR
MATH69.4%SR

Reasoning

HumanEvalOpenAI (2021)88.1%SR
DROP83.1%SR
GPQANYU + Cohere + Anthropic (2023)41.6%SR
SWE-Bench Verified40.6%SR
TAU-bench Airline22.8%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
80
Language
70
Legal
70
Finance
70
Healthcare
70
Reasoning
60
General
60
Code
60
Chat
50
Physics
40
Frontend Development
40
Biology
40
Chemistry
40
Communication
40
Tool Calling
40

Pricing

No pricing data available

Speed

No speed data available

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1OpenCode
$0.8
$4

Compare pricing across different API providers for this model.

External Sources