Phi-4 Mini Instruct
MicrosoftPhiOpen WeightMIT · Commercial OK
Description
Phi 4 Mini Instruct is a lightweight (3.8B parameters) open model built upon synthetic data and filtered web data, focusing on high-quality reasoning. It supports a 128K token context length and is enhanced for instruction adherence and safety via supervised fine-tuning and direct preference optimization.
Release Date
2024-02-26
Parameters
3.8B
Context Length
—
Modalities
—
Capability Radar
18
general
8
coding
18
reasoning
20
science
15
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 515 | 9.0 | AA |
| General Ranking | 526 | 17.0 | AA |
| Science | 518 | 17.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
52.0%SR
Creativity
Social IQa
72.5%SR
Arena Hard
32.8%SR
Finance
MMLU
67.3%SR
TruthfulQA
66.4%SR
MMLU-Pro
52.8%SR
General
ARC-C
83.7%SR
OpenBookQA
79.2%SR
PIQA
77.6%SR
Multilingual MMLU
49.3%SR
Language
BoolQ
81.2%SR
BIG-Bench Hard
70.4%SR
Winogrande
67.0%SR
Math
MATH-500
94.6%SR
GSM8k
88.6%SR
MATH
64.0%SR
MGSM
63.9%SR
AIMEMAA
57.5%SR
Reasoning
HellaSwagAI2 (2019)
69.1%SR
AA Evaluation Indices
(Artificial Analysis)Math Index(Artificial Analysis)6.7
Intelligence Index(Artificial Analysis)5.7
Coding Index(Artificial Analysis)3.8
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.5
Gpqa(NYU + Cohere + Anthropic (2023))0.3
Ifbench(Google Research (2023))0.2
Lcr(Artificial Analysis)0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.1
Scicode(UIUC + Argonne National Lab (2024))0.1
Tau2(Sierra + U Toronto + Vector Institute (2025))0.1
Aime 25(MAA (Mathematical Association of America))0.1
Hle(Center for AI Safety + Scale AI (2025))0.0
Aime(MAA (Mathematical Association of America))0.0
Terminalbench V2 10.0
Terminalbench Hard(Stanford × Laude Institute (2026))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Math70
Psychology70
Reasoning70
General70
Legal60
Language60
Finance60
Healthcare60
Physics50
Creativity50
Biology30
Chemistry30
Writing30
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec45.1
Time to First Token0.34s
Time to Answer0.34s
Provider Price Ranking
Provider Price Ranking
2 providers
Cheapest: Azure Cognitive ServicesMost Expensive: Azure
ProviderInputOutput
1Azure Cognitive ServicesCheapest
$0.075
$0.3
2Azure
$0.075
$0.3
Compare pricing across different API providers for this model.