Skip to main content

Claude 2.1

AnthropicClaude
Release Date
2023-11-21
Parameters
Context Length
1.0M
Modalities
image, pdf, text

Capability Radar

18
general
16
coding
19
reasoning
22
scienceest.
80
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking374
19.0
AA
General Ranking447
21.0
AA
Math Reasoning309
19.0
AA
Science438
21.0
AA

Benchmark Scores (LLM Stats)

Agents

Vending-Bench 2801759.0%SR
GDPval-AA1606.00 / 3000SR
DeepSearchQA91.3%SR
BrowseComp84.0%SR
CyberGym73.8%SR
OSWorld72.7%SR
Terminal-Bench 2.065.4%SR
MCP Atlas62.7%SR
Finance Agent60.7%SR
FrontierSWE56.0%SR
OpenRCA34.9%SR
Legal Agent Benchmark4.2%SR

Biology

GPQA91.3%SR

Code

SWE-Bench Verified80.8%SR
SWE-bench Multilingual77.8%SR

Communication

Tau2 Telecom99.3%SR
Tau2 Retail91.9%SR

General

MMMLU91.1%SR
MMMU-Pro77.3%SR
LiveBench76.3%SR
MRCR v2 (8-needle)76.0%SR

Healthcare

FigQA78.3%SR

Long Context

Graphwalks parents >128k95.4%SR
Graphwalks BFS >128k61.5%SR

Math

AIME 202599.8%SR
Humanity's Last Exam53.1%SR

Multimodal

CharXiv-R77.4%SR

Reasoning

ARC-AGI v268.8%SR

AA Evaluation Indices

Coding Index
14.0
Intelligence Index
3.9
Mmlu Pro
0.5
Math 500
0.4
Gpqa
0.3
Livecodebench
0.2
Scicode
0.2
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Agents
100
Finance
100
Legal
100
Reasoning
100
General
100
Communication
100
Language
90
Physics
90
Search
90
Biology
90
Chemistry
90
Long Context
80
Math
80
Multimodal
80
Safety
80
Spatial Reasoning
80
Frontend Development
80
Healthcare
80
Tool Calling
80
Code
70
Vision
70

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.5 / 1M tokens
Cache Write Price$6.25 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources