Claude 3 Haiku
AnthropicClaudeProprietary
Description
Claude 3 Haiku is the fastest and most compact model in the Claude 3 family, designed for near-instant responsiveness. It excels at answering simple queries and requests with unmatched speed, making it ideal for seamless AI experiences that mimic human interactions.
Release Date
2024-03-04
Parameters
—
Context Length
200K
Modalities
image, text
Capability Radar
11
general
11
coding
20
reasoning
24
scienceest.
0
agents
80
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 396 | 14.0 | AA |
| General Ranking | 433 | 21.0 | AA |
| Math Reasoning | 308 | 19.0 | AA |
| Reasoning | 19 | 86.0 | LS |
| Science | 395 | 24.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
33.3%SR
Code
HumanEval
75.9%SR
Finance
MMLU
75.2%SR
General
ARC-C
89.2%SR
Language
BIG-Bench Hard
73.7%SR
Math
GSM8k
88.9%SR
DROP
78.4%SR
MGSM
75.1%SR
MATH
38.9%SR
Reasoning
HellaSwag
85.9%SR
AA Evaluation Indices
Intelligence Index12.3
Coding Index6.7
Math 5000.4
Gpqa0.4
Ifbench0.4
Tau20.2
Lcr0.2
Scicode0.2
Livecodebench0.2
Hle0.0
Aime0.0
Terminalbench Hard0.0
LLM Stats Category Scores
Code80
Finance80
Healthcare80
Legal80
General70
Language70
Math70
Reasoning70
Biology30
Chemistry30
Physics30
Pricing
Input Price$0.25 / 1M tokens
Output Price$1.25 / 1M tokens
Blended Price (3:1)$0.5 / 1M tokens
Speed
Tokens/sec0.0 tokens/s
Time to First Token0.00s
Time to Answer0.00s
Available Providers
(LS internal units)No provider data available