Skip to main content

Claude 3.5 Haiku

AnthropicClaudeProprietary

Description

Claude 3.5 Haiku is Anthropic's fastest model, delivering advanced coding, tool use, and reasoning capabilities at an accessible price. It excels at user-facing products, specialized sub-agent tasks, and generating personalized experiences from large data volumes. The model is particularly well-suited for code completions, interactive chatbots, data extraction, and real-time content moderation.

Release Date
2024-10-22
Parameters
Context Length
Modalities
text

Capability Radar

26
general
22
coding
31
reasoning
29
science
40
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking410
21.0
AA
General Ranking367
35.0
AA
Science441
29.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)41.6%SR

Code

HumanEvalOpenAI (2021)88.1%SR
SWE-Bench Verified40.6%SR

Communication

TAU-bench Retail51.0%SR
TAU-bench Airline22.8%SR

Finance

MMLU-Pro65.0%SR

Math

MGSM85.6%SR
DROP83.1%SR
MATH69.4%SR

AA Evaluation Indices

(Artificial Analysis)
Coding Index(Artificial Analysis)
15.9
Intelligence Index(Artificial Analysis)
12.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.6
Ifbench(Google Research (2023))
0.4
Gpqa(NYU + Cohere + Anthropic (2023))
0.4
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.3
Scicode(UIUC + Argonne National Lab (2024))
0.3
Lcr(Artificial Analysis)
0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.2
Terminalbench V2 1
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0
Aime(MAA (Mathematical Association of America))
0.0
Terminalbench Hard(Stanford × Laude Institute (2026))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Math
80
Language
70
Legal
70
Finance
70
Healthcare
70
Reasoning
60
General
60
Code
60
Physics
40
Frontend Development
40
Biology
40
Chemistry
40
Communication
40
Tool Calling
40

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1OpenCode Zen
$0.8
$4

Compare pricing across different API providers for this model.

External Sources