Phi-4
MicrosoftPhiOpen WeightMIT · Commercial OK
Description
phi-4 is a state-of-the-art open model built to excel at advanced reasoning, coding, and knowledge tasks. It leverages a blend of synthetic data, filtered web data, academic texts, and supervised fine-tuning for precision, alignment, and safety.
Release Date
2024-12-12
Parameters
14.7B
Context Length
16K
Modalities
text
Capability Radar
70
general
80
coding
70
reasoning
51
scienceest.
73
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
IFEvalGoogle Research (2023)
83.4%SR
Factuality
SimpleQA
3.0%SR
General
MMLU
84.8%SR
Arena Hard
73.3%SR
Language
MMLU-Pro
74.3%SR
Math
MGSM
80.6%SR
MATH
80.4%SR
OmniMath
76.6%SR
AIME 2024
75.3%SR
AIME 2025
62.9%SR
LiveBench
47.6%SR
Reasoning
FlenQA
97.7%SR
HumanEval+
92.9%SR
HumanEvalOpenAI (2021)
82.6%SR
DROP
75.5%SR
PhiBench
70.6%SR
GPQANYU + Cohere + Anthropic (2023)
65.8%SR
LiveCodeBench
53.8%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Language80
Legal80
Finance80
Healthcare80
Code80
Creativity80
Writing80
Chat70
Math70
Reasoning70
General70
Instruction Following60
Physics60
Structured Output60
Biology60
Chemistry60
Factuality0
Pricing
Input Price$0.125 / 1M tokens
Output Price$0.5 / 1M tokens
Blended Price (3:1)$0.0875 / 1M tokens
Speed
Tokens/sec37.0
Time to First Token2.51s
Time to Answer2.51s
Provider Price Ranking
Provider Price Ranking
6 providers
Cheapest: Kilo GatewayMost Expensive: Azure
ProviderInputOutput
1Kilo GatewayCheapest
$0.056
$0.112
2DeepInfra
$0.07
$0.14
3OpenRouter
$0.07
$0.14
4MicrosoftPRIMARY
$0.125
$0.5
5Azure Cognitive Services
$0.125
$0.5
6Azure
$0.125
$0.5
Compare pricing across different API providers for this model.