Claude 3 Haiku
AnthropicClaudeProprietary
Description
Claude 3 Haiku is the fastest and most compact model in the Claude 3 family, designed for near-instant responsiveness. It excels at answering simple queries and requests with unmatched speed, making it ideal for seamless AI experiences that mimic human interactions.
Release Date
2024-03-04
Parameters
—
Context Length
—
Modalities
image, text
Capability Radar
70
general
80
coding
70
reasoning
26
scienceest.
73
agents
80
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))General
MMLU
75.2%SR
Math
GSM8k
88.9%SR
MGSM
75.1%SR
MATH
38.9%SR
Reasoning
ARC-C
89.2%SR
HellaSwagAI2 (2019)
85.9%SR
DROP
78.4%SR
HumanEvalOpenAI (2021)
75.9%SR
BIG-Bench Hard
73.7%SR
GPQANYU + Cohere + Anthropic (2023)
33.3%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Legal80
Finance80
Healthcare80
Code80
Language70
Math70
Reasoning70
General70
Physics30
Biology30
Chemistry30
Pricing
Input Price$0.25 / 1M tokens
Output Price$1.25 / 1M tokens
Speed
No speed data available
Provider Price Ranking
Provider Price Ranking
1 providers
ProviderInputOutput
1AnthropicPRIMARY
$0.25
$1.25
Compare pricing across different API providers for this model.