Skip to main content

Claude 2.0

AnthropicClaude
Release Date
2023-07-11
Parameters
Context Length
1.0M
Modalities
image, pdf, text

Capability Radar

19
general
15
coding
10
reasoning
28
scienceest.
80
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Agentic Capability24
62.0
LS
Code Ranking389
17.0
AA
General Ranking455
20.0
AA
Math Reasoning356
0.0
AA
Multimodal Ranking41
77.0
LS
Reasoning50
69.0
LS
Science364
31.0
AA

Benchmark Scores (LLM Stats)

Agents

Vending-Bench 2801759.0%SR
GDPval-AA1606.00 / 3000SR
DeepSearchQA91.3%SR
BrowseComp84.0%SR
CyberGym73.8%SR
OSWorld72.7%SR
Terminal-Bench 2.065.4%SR
MCP Atlas62.7%SR
Finance Agent60.7%SR
FrontierSWE56.0%SR
OpenRCA34.9%SR
Legal Agent Benchmark4.2%SR

Biology

GPQA91.3%SR

Code

SWE-Bench Verified80.8%SR
SWE-bench Multilingual77.8%SR

Communication

Tau2 Telecom99.3%SR
Tau2 Retail91.9%SR

General

MMMLU91.1%SR
MMMU-Pro77.3%SR
LiveBench76.3%SR
MRCR v2 (8-needle)76.0%SR

Healthcare

FigQA78.3%SR

Long Context

Graphwalks parents >128k95.4%SR
Graphwalks BFS >128k61.5%SR

Math

AIME 202599.8%SR
Humanity's Last Exam53.1%SR

Multimodal

CharXiv-R77.4%SR

Reasoning

ARC-AGI v268.8%SR

AA Evaluation Indices

Coding Index
12.9
Intelligence Index
3.6
Mmlu Pro
0.5
Gpqa
0.3
Scicode
0.2
Livecodebench
0.2
Aime
0.0

LLM Stats Category Scores

Agents
100
Finance
100
Legal
100
Reasoning
100
General
100
Communication
100
Language
90
Physics
90
Search
90
Biology
90
Chemistry
90
Long Context
80
Math
80
Multimodal
80
Safety
80
Spatial Reasoning
80
Frontend Development
80
Healthcare
80
Tool Calling
80
Code
70
Vision
70

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.5 / 1M tokens
Cache Write Price$6.25 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

14 providers

Cheapest: 302.AIMost Expensive: Venice AI
ProviderInputOutput
1302.AICheapest
$5
$25
2Abacus
$5
$25
3Jiekou.AI
$5
$25
4OpenCode Zen
$5
$25
5FrogBot
$5
$25
6AIHubMix
$5
$25
7Azure Cognitive Services
$5
$25
8LLM Gateway
$5
$25
9Azure
$5
$25
10Anthropic
$5
$25
11Auriko
$5
$25
12FreeModel
$5
$25
13Neon
$5
$25
14Venice AI
$6
$30

Compare pricing across different API providers for this model.

External Sources