Skip to main content

Qwen3 8B (Reasoning)

AlibabaQwen
Release Date
2025-04-28
Parameters
Context Length
262K
Modalities
audio, image, text, video

Capability Radar

27
general
37
coding
48
reasoning
35
scienceest.
60
agents
80
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking405
16.0
AA
General Ranking350
32.0
AA
Math Reasoning203
45.0
AA
Science340
34.0
AA

Benchmark Scores (LLM Stats)

3d

SUNRGBD0.36 / 100SR
Hypersim0.13 / 100SR

Agents

GDPval-AA985.00 / 3000SR
t2-bench79.5%SR
BFCL-V472.2%SR
AndroidWorld_SR66.4%SR
BrowseComp63.8%SR
FullStackBench en62.6%SR
WideSearch60.5%SR
FullStackBench zh58.7%SR
OSWorld-Verified58.0%SR
TIR-Bench53.2%SR
Terminal-Bench 2.049.4%SR
VITA-Bench33.6%SR
DeepPlanning24.1%SR

Biology

GPQA86.6%SR

Chemistry

SuperGPQA67.1%SR

Code

SWE-Bench Verified72.0%SR

Communication

Multi-Challenge61.5%SR

Embodied

EmbSpatialBench0.84 / 100SR

Finance

MMLU-Pro86.7%SR
MMLU-ProX82.2%SR

General

MMLU-Redux94.0%SR
IFEval93.4%SR
C-Eval91.9%SR
Global PIQA88.4%SR
MAXIFE87.9%SR
MMMLU86.7%SR
MMMU83.9%SR
MMStar82.9%SR
Include82.8%SR
LiveCodeBench v678.9%SR
MMMU-Pro76.9%SR
IFBench76.1%SR
SimpleVQA0.62 / 100SR
LongBench v260.2%SR
NOVA-6358.6%SR

Grounding

RefCOCO-avg0.91 / 100SR
ScreenSpot Pro70.4%SR
RefSpatialBench0.69 / 100SR

Healthcare

VideoMMMU82.0%SR
SlakeVQA81.6%SR
MedXpertQA67.3%SR
PMC-VQA63.3%SR

Image To Text

OCRBench92.1%SR

Language

LingoQA80.8%SR
WMT24++78.3%SR

Long Context

MLVU87.3%SR
LVBench74.4%SR
AA-LCR66.9%SR
MMLongBench-Doc0.59 / 100SR

Math

HMMT 202591.4%SR
HMMT2590.3%SR
MathVista-Mini87.4%SR
MathVision86.2%SR
DynaMath85.9%SR
CodeForces0.85 / 3000SR
PolyMATH68.9%SR
Humanity's Last Exam47.5%SR

Multimodal

VLMsAreBlind96.7%SR
AI2D93.3%SR
V*93.2%SR
MMBench-V1.192.8%SR
OmniDocBench 1.589.8%SR
VideoMME w sub.87.3%SR
VideoMME w/o sub.83.9%SR
CC-OCR81.8%SR
CharXiv-R77.2%SR
MVBench76.6%SR
MMVU74.7%SR
BabyVision40.2%SR
ZEROBench-Sub0.36 / 100SR
Nuscene15.4%SR
ZEROBench0.09 / 100SR

Reasoning

CountBench0.97 / 100SR
BrowseComp-zh69.9%SR
Hallusion Bench67.6%SR
ERQA62.0%SR
Seal-044.1%SR
OJBench39.5%SR

Spatial Reasoning

RealWorldQA85.1%SR

Vision

ODinW44.5%SR

AA Evaluation Indices

Math Index
19.0
Intelligence Index
7.4
Math 500
0.9
Aime
0.7
Mmlu Pro
0.7
Gpqa
0.6
Livecodebench
0.4
Ifbench
0.3
Tau2
0.3
Scicode
0.2
Aime 25
0.2
Hle
0.0
Terminalbench Hard
0.0
Lcr
0.0

LLM Stats Category Scores

Legal
100
Finance
100
Agents
76
General
46
Reasoning
19
Biology
90
Image To Text
80
Instruction Following
80
Language
80
Math
80
Physics
80
Structured Output
80
Embodied
80
Grounding
80
Healthcare
80
Chemistry
80
Text-to-image
80
Video
80
Long Context
70
Multimodal
70
Spatial Reasoning
70
Frontend Development
70
Economics
70
Vision
70
Search
60
Code
60
Communication
60
Tool Calling
60
Spatial
20
3d
20

Pricing

Input Price$0.11 / 1M tokens
Output Price$1.15 / 1M tokens
Blended Price (3:1)$0.37 / 1M tokens

Speed

Tokens/sec61.5
Time to First Token1.43s
Time to Answer33.98s

Provider Price Ranking

Provider Price Ranking

7 providers

Cheapest: OpenRouterMost Expensive: NanoGPT
ProviderInputOutput
1OpenRouterCheapest
$0.05
$0.4
2Kilo Gateway
$0.05
$0.4
3SiliconFlow (China)
$0.06
$0.06
4SiliconFlow
$0.06
$0.06
5Alibaba (China)
$0.072
$0.287
6AlibabaPRIMARY
$0.11
$1.15
7NanoGPT
$0.3
$0.3

Compare pricing across different API providers for this model.

External Sources