DeepSeek R1 (Jan '25)

DeepSeekDeepSeek

Release Date

2025-01-20

Parameters

—

Context Length

64K

Modalities

text

Capability Radar

general

coding

reasoning

scienceest.

agents

multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain	#Rank	Score	Source
Code Ranking	193	49.0	AA
General Ranking	295	37.0	AA
Math Reasoning	101	75.0	AA
Science	196	49.0	AA

Benchmark Scores (LLM Stats)

Agents

GDPval-AA

1332.00 / 3000SR

BrowseComp

83.4%SR

MCP Atlas

73.6%SR

Terminal-Bench 2.0

67.9%SR

SWE-Bench Pro

55.4%SR

Toolathlon

51.8%SR

FrontierSWE

29.0%SR

Biology

GPQA

90.1%SR

Code

LiveCodeBench

93.5%SR

SWE-Bench Verified

80.6%SR

SWE-bench Multilingual

76.2%SR

Factuality

SimpleQA

57.9%SR

Finance

MMLU-Pro

87.5%SR

General

CSimpleQA

84.4%SR

MRCR 1M

83.5%SR

LiveBench

73.6%SR

CorpusQA 1M

62.0%SR

Math

CodeForces

1.00 / 3000SR

HMMT Feb 26

95.2%SR

MathArena Apex

90.2%SR

IMO-AnswerBench

89.8%SR

Humanity's Last Exam

48.2%SR

AA Evaluation Indices

Math Index

68.0

Intelligence Index

12.6

Math 500

1.0

Mmlu Pro

0.8

Gpqa

0.7

Aime

0.7

Aime 25

0.7

Livecodebench

0.6

Lcr

0.5

Ifbench

0.4

Scicode

0.4

Tau2

0.1

Hle

0.1

Terminalbench Hard

0.1

LLM Stats Category Scores

Legal

100

Finance

100

Agents

100

General

100

Reasoning

Physics

Language

Healthcare

Biology

Chemistry

Math

Long Context

Frontend Development

Code

Factuality

Tool Calling

Vision

Pricing

Input Price$1.675 / 1M tokens

Output Price$4.7 / 1M tokens

Blended Price (3:1)$2.431 / 1M tokens

Speed

Tokens/sec0.0

Time to First Token0.00s

Time to Answer0.00s

Provider Price Ranking

14 providers

Cheapest: NanoGPTMost Expensive: Together AI

ProviderInputOutput

1NanoGPTCheapest

$0.4

$1.7

2SiliconFlow (China)

$0.5

$2.18

3SiliconFlow

$0.5

$2.18

4Synthetic

$0.55

$2.19

5D.Run (China)

$0.55

$2.2

6Alibaba (China)

$0.574

$2.294

7OpenRouter

$0.7

$2.5

8Kilo Gateway

$0.7

$2.5

9Azure Cognitive Services

$1.35

$5.4

10Vercel AI Gateway

$1.35

$5.4

11Azure

$1.35

$5.4

12DeepSeekPRIMARY

$1.675

$4.7

13Abacus

14Together AI

Compare pricing across different API providers for this model.

External Sources

Artificial Analysis