Claude 3.5 Sonnet
AnthropicClaudeProprietary
描述
Claude 3.5 Sonnet is a powerful AI model with industry-leading software engineering skills. It excels in coding, planning, and problem-solving, with significant improvements in agentic coding and tool use tasks. The model includes computer use capabilities in public beta, allowing it to interact with computer interfaces like a human user.
發布日期
2024-10-22
參數規模
—
上下文長度
—
支援模態
image, text
能力雷達圖
80
general
70
coding
90
reasoning
60
science估算
60
agents
100
multimodal
缺少專門科學評測時,Science 由 LLM Stats 科學得分或推理能力估算。
排行榜排名
| 領域 | #排名 | 分數 | 來源 |
|---|---|---|---|
| 多模態榜 | 6 | 65.0 | LS |
基準測試分數 (LLM Stats)
(LLM Stats (zeroeval))Agents
OSWorld Extended
22.0%自報
OSWorld Screenshot-only
14.9%自報
Biology
GPQANYU + Cohere + Anthropic (2023)
67.2%自報
Code
HumanEvalOpenAI (2021)
93.7%自報
SWE-Bench Verified
49.0%自報
Communication
TAU-bench Retail
69.2%自報
TAU-bench Airline
46.0%自報
Finance
MMLU
90.4%自報
MMLU-Pro
77.6%自報
General
MMMU
68.3%自報
Image To Text
DocVQADocVQA (2020)
95.2%自報
Language
BIG-Bench Hard
93.1%自報
Math
GSM8k
96.4%自報
MGSM
91.6%自報
DROP
87.1%自報
MATH
78.3%自報
MathVista
67.7%自報
Multimodal
AI2D
94.7%自報
ChartQAMasry et al. (2022)
90.8%自報
AA 評測指數
(Artificial Analysis)暫無 AA 評測資料
LLM Stats 分類評分
(LLM Stats (zeroeval))Image To Text100
Math90
Language90
Legal80
Multimodal80
Reasoning80
Finance80
General80
Healthcare80
Vision80
Physics70
Biology70
Chemistry70
Code70
Communication60
Tool Calling60
Frontend Development50
定價
暫無定價資料
速度
暫無速度資料
供應商價格排行
暫無提供商資料