Claude 3.5 Haiku
AnthropicClaudeProprietary
Description
Claude 3.5 Haiku is Anthropic's fastest model, delivering advanced coding, tool use, and reasoning capabilities at an accessible price. It excels at user-facing products, specialized sub-agent tasks, and generating personalized experiences from large data volumes. The model is particularly well-suited for code completions, interactive chatbots, data extraction, and real-time content moderation.
Release Date
2024-10-22
Parameters
—
Context Length
200K
Modalities
image, text
Capability Radar
30
general
20
coding
31
reasoning
29
scienceest.
40
agents
80
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 331 | 21.0 | AA |
| General Ranking | 294 | 37.0 | AA |
| Math Reasoning | 239 | 37.0 | AA |
| Science | 359 | 30.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
41.6%SR
Code
HumanEval
88.1%SR
SWE-Bench Verified
40.6%SR
Communication
TAU-bench Retail
51.0%SR
TAU-bench Airline
22.8%SR
Finance
MMLU-Pro
65.0%SR
Math
MGSM
85.6%SR
DROP
83.1%SR
MATH
69.4%SR
AA Evaluation Indices
Intelligence Index18.7
Coding Index10.7
Math 5000.7
Mmlu Pro0.6
Ifbench0.4
Gpqa0.4
Livecodebench0.3
Scicode0.3
Tau20.2
Lcr0.2
Hle0.0
Aime0.0
Terminalbench Hard0.0
LLM Stats Category Scores
Math80
Finance70
Healthcare70
Language70
Legal70
Code60
Reasoning60
General50
Tool Calling40
Biology40
Chemistry40
Communication40
Frontend Development40
Physics40
Pricing
Input Price$1 / 1M tokens
Output Price$4 / 1M tokens
Blended Price (3:1)$1.75 / 1M tokens
Speed
Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s
Available Providers
(LS internal units)No provider data available