Claude 3.5 Haiku
AnthropicClaudeProprietary
Description
Claude 3.5 Haiku is Anthropic's fastest model, delivering advanced coding, tool use, and reasoning capabilities at an accessible price. It excels at user-facing products, specialized sub-agent tasks, and generating personalized experiences from large data volumes. The model is particularly well-suited for code completions, interactive chatbots, data extraction, and real-time content moderation.
Release Date
2024-10-22
Parameters
—
Context Length
200K
Modalities
image, pdf, text
Capability Radar
26
general
31
coding
31
reasoning
29
scienceest.
40
agents
80
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 342 | 23.0 | AA |
| General Ranking | 310 | 35.0 | AA |
| Math Reasoning | 239 | 37.0 | AA |
| Science | 382 | 29.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
41.6%SR
Code
HumanEval
88.1%SR
SWE-Bench Verified
40.6%SR
Communication
TAU-bench Retail
51.0%SR
TAU-bench Airline
22.8%SR
Finance
MMLU-Pro
65.0%SR
Math
MGSM
85.6%SR
DROP
83.1%SR
MATH
69.4%SR
AA Evaluation Indices
Intelligence Index12.4
Math 5000.7
Mmlu Pro0.6
Ifbench0.4
Gpqa0.4
Livecodebench0.3
Scicode0.3
Tau20.2
Lcr0.2
Hle0.0
Aime0.0
Terminalbench Hard0.0
LLM Stats Category Scores
Math80
Language70
Legal70
Finance70
Healthcare70
Reasoning60
Code60
General50
Physics40
Frontend Development40
Biology40
Chemistry40
Communication40
Tool Calling40
Pricing
Input Price$0.8 / 1M tokens
Output Price$4 / 1M tokens
Blended Price (3:1)$1.6 / 1M tokens
Cache Read Price$0.08 / 1M tokens
Cache Write Price$1 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
13 providers
Cheapest: HeliconeMost Expensive: Vertex
ProviderInputOutput
1HeliconeCheapest
$0.8
$4
2AnthropicPRIMARY
$0.8
$4
3302.AI
$0.8
$4
4NanoGPT
$0.8
$4
5ZenMux
$0.8
$4
6Kilo Gateway
$0.8
$4
7Cloudflare AI Gateway
$0.8
$4
8OpenCode Zen
$0.8
$4
9Vertex (Anthropic)
$0.8
$4
10DigitalOcean
$0.8
$4
11Vercel AI Gateway
$0.8
$4
12LLM Gateway
$0.8
$4
13Vertex
$0.8
$4
Compare pricing across different API providers for this model.