Skip to main content

DeepSeek Coder V2 Lite Instruct

DeepSeekDeepSeek
Release Date
2024-06-17
Parameters
Context Length
1.0M
Modalities
text

Capability Radar

15
general
15
coding
32
reasoning
20
scienceest.
60
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking390
17.0
AA
General Ranking469
17.0
AA
Science445
19.0
AA

Benchmark Scores (LLM Stats)

Agents

GDPval-AA1332.00 / 3000SR
BrowseComp83.4%SR
MCP Atlas73.6%SR
Terminal-Bench 2.067.9%SR
SWE-Bench Pro55.4%SR
Toolathlon51.8%SR
FrontierSWE29.0%SR

Biology

GPQA90.1%SR

Code

LiveCodeBench93.5%SR
SWE-Bench Verified80.6%SR
SWE-bench Multilingual76.2%SR

Factuality

SimpleQA57.9%SR

Finance

MMLU-Pro87.5%SR

General

CSimpleQA84.4%SR
MRCR 1M83.5%SR
LiveBench73.6%SR
CorpusQA 1M62.0%SR

Math

CodeForces1.00 / 3000SR
HMMT Feb 2695.2%SR
MathArena Apex90.2%SR
IMO-AnswerBench89.8%SR
Humanity's Last Exam48.2%SR

AA Evaluation Indices

Intelligence Index
3.1
Mmlu Pro
0.4
Gpqa
0.3
Livecodebench
0.2
Scicode
0.1
Hle
0.1

LLM Stats Category Scores

Legal
100
Finance
100
Agents
100
General
100
Reasoning
71
Language
90
Physics
90
Healthcare
90
Biology
90
Chemistry
90
Long Context
80
Math
80
Search
80
Frontend Development
80
Code
70
Factuality
60
Tool Calling
60
Vision
50

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.00363 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

No provider data available

External Sources