Phi-4
MicrosoftPhiOpen WeightMIT · Commercial OK
Description
phi-4 is a state-of-the-art open model built to excel at advanced reasoning, coding, and knowledge tasks. It leverages a blend of synthetic data, filtered web data, academic texts, and supervised fine-tuning for precision, alignment, and safety.
Release Date
2024-12-12
Parameters
14.7B
Context Length
16K
Modalities
text
Capability Radar
25
general
24
coding
30
reasoning
36
scienceest.
28
agents
0
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 447 | 10.0 | AA |
| General Ranking | 431 | 22.0 | AA |
| Math Reasoning | 267 | 30.0 | AA |
| Science | 320 | 35.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
56.1%SR
Code
HumanEval
82.6%SR
Creativity
Arena Hard
75.4%SR
Factuality
SimpleQA
3.0%SR
Finance
MMLU
84.8%SR
MMLU-Pro
70.4%SR
General
IFEval
63.0%SR
PhiBench
56.2%SR
LiveBench
47.6%SR
Math
MGSM
80.6%SR
MATH
80.4%SR
DROP
75.5%SR
Reasoning
HumanEval+
82.8%SR
AA Evaluation Indices
Math Index18.0
Intelligence Index4.9
Math 5000.8
Mmlu Pro0.7
Gpqa0.6
Scicode0.3
Ifbench0.2
Livecodebench0.2
Aime 250.2
Aime0.1
Hle0.0
Terminalbench Hard0.0
Lcr0.0
Tau20.0
LLM Stats Category Scores
Language80
Legal80
Finance80
Healthcare80
Code80
Creativity80
Writing80
Math70
Reasoning70
Instruction Following60
Physics60
Structured Output60
General60
Biology60
Chemistry60
Factuality0
Pricing
Input Price$0.125 / 1M tokens
Output Price$0.5 / 1M tokens
Blended Price (3:1)$0.219 / 1M tokens
Speed
Tokens/sec40.8
Time to First Token0.47s
Time to Answer0.47s
Provider Price Ranking
Provider Price Ranking
3 providers
Cheapest: MicrosoftMost Expensive: Azure
ProviderInputOutput
1MicrosoftPRIMARY
$0.125
$0.5
2Azure Cognitive Services
$0.17
$0.68
3Azure
$0.17
$0.68
Compare pricing across different API providers for this model.