Skip to main content
AITier

DeepSeek V3 (Dec '24)

DeepSeekDeepSeekOpen WeightMIT + Model License (Commercial use allowed)

Description

A powerful Mixture-of-Experts (MoE) language model with 671B total parameters (37B activated per token). Features Multi-head Latent Attention (MLA), auxiliary-loss-free load balancing, and multi-token prediction training. Pre-trained on 14.8T tokens with strong performance in reasoning, math, and code tasks.

Release Date
2024-12-26
Parameters
671.0B
Context Length
—
Modalities
text

Capability Radar

31
general
29
coding
38
reasoning
38
science
35
agents
0
multimodal

Rankings

Domain#RankScoreSource
Code Ranking355
29.0
AA
General Ranking362
36.0
AA
Science357
39.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)59.1%SR

Code

Aider-Polyglot Edit79.7%SR
Aider-Polyglot49.6%SR
SWE-Bench Verified42.0%SR
LiveCodeBench37.6%SR

Factuality

SimpleQA24.9%SR

Finance

MMLU88.5%SR
MMLU-Pro75.9%SR

General

MMLU-Redux89.1%SR
C-Eval86.5%SR
IFEvalGoogle Research (2023)86.1%SR
CSimpleQA64.8%SR
LongBench v248.7%SR

Language

CLUEWSC90.9%SR

Math

DROP91.6%SR
MATH-50090.2%SR
CNMO 202443.2%SR
AIME 202439.2%SR

Reasoning

HumanEval-Mul82.6%SR
FRAMES73.3%SR

AA Evaluation Indices

(Artificial Analysis)
Math Index(Artificial Analysis)
26.0
Coding Index(Artificial Analysis)
23.0
Intelligence Index(Artificial Analysis)
14.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.9
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.8
Gpqa(NYU + Cohere + Anthropic (2023))
0.6
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.4
Scicode(UIUC + Argonne National Lab (2024))
0.4
Ifbench(Google Research (2023))
0.3
Lcr(Artificial Analysis)
0.3
Aime 25(MAA (Mathematical Association of America))
0.3
Aime(MAA (Mathematical Association of America))
0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.2
Terminalbench V2 1
0.2
Terminalbench Hard(Stanford × Laude Institute (2026))
0.1
Tau Banking
0.0
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Instruction Following
90
Legal
80
Language
80
Finance
80
Healthcare
80
Math
70
Reasoning
70
Structured Output
70
General
70
Physics
60
Biology
60
Chemistry
60
Long Context
50
Code
50
Frontend Development
40
Factuality
20

Pricing

Input Price$0.36 / 1M tokens
Output Price$0.89 / 1M tokens
Blended Price (3:1)$0.493 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

3 providers

Cheapest: Alibaba (China)Most Expensive: Helicone
ProviderInputOutput
1Alibaba (China)Cheapest
$0.287
$1.147
2DeepSeekPRIMARY
$0.36
$0.89
3Helicone
$0.56
$1.68

Compare pricing across different API providers for this model.

External Sources

LLM StatsArtificial Analysis