DeepSeek V3 (Dec '24)
DeepSeekDeepSeekOpen WeightMIT + Model License (Commercial use allowed)
Description
A powerful Mixture-of-Experts (MoE) language model with 671B total parameters (37B activated per token). Features Multi-head Latent Attention (MLA), auxiliary-loss-free load balancing, and multi-token prediction training. Pre-trained on 14.8T tokens with strong performance in reasoning, math, and code tasks.
Release Date
2024-12-26
Parameters
671.0B
Context Length
—
Modalities
text
Capability Radar
28
general
29
coding
38
reasoning
38
science
35
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 441 | 28.0 | AA |
| General Ranking | 434 | 32.0 | AA |
| Science | 426 | 35.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
86.1%SR
Factuality
SimpleQA
24.9%SR
General
MMLU
88.5%SR
C-Eval
86.5%SR
Aider-Polyglot Edit
79.7%SR
CSimpleQA
64.8%SR
Aider-Polyglot
49.6%SR
Language
CLUEWSC
90.9%SR
MMLU-Redux
89.1%SR
MMLU-Pro
75.9%SR
Long Context
LongBench v2
48.7%SR
Math
MATH-500
90.2%SR
CNMO 2024
43.2%SR
AIME 2024
39.2%SR
Reasoning
DROP
91.6%SR
HumanEval-Mul
82.6%SR
FRAMES
73.3%SR
GPQANYU + Cohere + Anthropic (2023)
59.1%SR
SWE-Bench Verified
42.0%SR
LiveCodeBench
37.6%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))88.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))75.2
Gpqa(NYU + Cohere + Anthropic (2023))55.7
Livecodebench(UC Berkeley + MIT + Cornell (2024))35.9
Scicode(UIUC + Argonne National Lab (2024))35.8
Ifbench(Google Research (2023))34.8
Lcr(Artificial Analysis)29.3
Math Index(Artificial Analysis)26.0
Aime 25(MAA (Mathematical Association of America))26.0
Aime(MAA (Mathematical Association of America))25.3
Coding Index(Artificial Analysis)23.0
Tau2(Sierra + U Toronto + Vector Institute (2025))22.8
Terminalbench V2 116.9
Intelligence Index(Artificial Analysis)8.5
Terminalbench Hard(Stanford × Laude Institute (2026))6.8
Tau Banking4.7
Hle(Center for AI Safety + Scale AI (2025))2.9
Terminalbench V4 00.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat90
Instruction Following90
Language80
Legal80
Finance80
Healthcare80
Math70
Reasoning70
Search70
Structured Output70
General70
Physics60
Biology60
Chemistry60
Long Context50
Code50
Frontend Development40
Factuality20
Pricing
Input Price$0.32 / 1M tokens
Output Price$0.89 / 1M tokens
Blended Price (3:1)$0.463 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: DeepInfraMost Expensive: Helicone
ProviderInputOutput
1DeepInfraCheapest
$0
$0
2Alibaba (China)
$0.287
$1.147
3DeepSeekPRIMARY
$0.32
$0.89
4Helicone
$0.56
$1.68
Compare pricing across different API providers for this model.