DeepSeek R1 (Jan '25)

DeepSeekDeepSeek

Release Date

2025-01-20

Parameters

—

Context Length

64K

Modalities

text

Capability Radar

general

coding

reasoning

scienceest.

agents

multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain	#Rank	Score	Source
Code Ranking	193	49.0	AA
General Ranking	295	37.0	AA
Math Reasoning	101	75.0	AA
Science	196	49.0	AA

Benchmark Scores (LLM Stats)

Agents

GDPval-AA

1332.00 / 3000SR

BrowseComp

83.4%SR

MCP Atlas

73.6%SR

Terminal-Bench 2.0

67.9%SR

SWE-Bench Pro

55.4%SR

Toolathlon

51.8%SR

FrontierSWE

29.0%SR

Biology

GPQA

90.1%SR

Code

LiveCodeBench

93.5%SR

SWE-Bench Verified

80.6%SR

SWE-bench Multilingual

76.2%SR

Factuality

SimpleQA

57.9%SR

Finance

MMLU-Pro

87.5%SR

General

CSimpleQA

84.4%SR

MRCR 1M

83.5%SR

LiveBench

73.6%SR

CorpusQA 1M

62.0%SR

Math

CodeForces

1.00 / 3000SR

HMMT Feb 26

95.2%SR

MathArena Apex

90.2%SR

IMO-AnswerBench

89.8%SR

Humanity's Last Exam

48.2%SR

AA Evaluation Indices

Math Index

68.0

Intelligence Index

12.6

Math 500

1.0

Mmlu Pro

0.8

Gpqa

0.7

Aime

0.7

Aime 25

0.7

Livecodebench

0.6

Lcr

0.5

Ifbench

0.4

Scicode

0.4

Tau2

0.1

Hle

0.1

Terminalbench Hard

0.1

LLM Stats Category Scores

Legal

100

Finance

100

Agents

100

General

100

Reasoning

Language

Physics

Healthcare

Biology

Chemistry

Long Context

Math

Frontend Development

Code

Factuality

Tool Calling

Vision

Pricing

Input Price$1.675 / 1M tokens

Output Price$4.7 / 1M tokens

Blended Price (3:1)$2.431 / 1M tokens

Speed

Tokens/sec0.0

Time to First Token0.00s

Time to Answer0.00s

Provider Price Ranking

15 providers

Cheapest: NanoGPTMost Expensive: Together AI

ProviderInputOutput

1NanoGPTCheapest

$0.4

$1.7

2SiliconFlow (China)

$0.5

$2.18

3SiliconFlow

$0.5

$2.18

4Synthetic

$0.55

$2.19

5D.Run (China)

$0.55

$2.2

6Alibaba (China)

$0.574

$2.294

7OpenRouter

$0.7

$2.5

8Hugging Face

$0.7

$2.5

9Kilo Gateway

$0.7

$2.5

10Azure Cognitive Services

$1.35

$5.4

11Vercel AI Gateway

$1.35

$5.4

12Azure

$1.35

$5.4

13DeepSeekPRIMARY

$1.675

$4.7

14Abacus

15Together AI

Compare pricing across different API providers for this model.

External Sources

Artificial Analysis