Skip to main content

Phi-4

MicrosoftPhiOpen WeightMIT · Commercial OK

Description

phi-4 is a state-of-the-art open model built to excel at advanced reasoning, coding, and knowledge tasks. It leverages a blend of synthetic data, filtered web data, academic texts, and supervised fine-tuning for precision, alignment, and safety.

Release Date
2024-12-12
Parameters
14.7B
Context Length
16K
Modalities
text

Capability Radar

70
general
80
coding
70
reasoning
51
scienceest.
73
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Chat

IFEvalGoogle Research (2023)83.4%SR

Factuality

SimpleQA3.0%SR

General

MMLU84.8%SR
Arena Hard73.3%SR

Language

MMLU-Pro74.3%SR

Math

MGSM80.6%SR
MATH80.4%SR
OmniMath76.6%SR
AIME 202475.3%SR
AIME 202562.9%SR
LiveBench47.6%SR

Reasoning

FlenQA97.7%SR
HumanEval+92.9%SR
HumanEvalOpenAI (2021)82.6%SR
DROP75.5%SR
PhiBench70.6%SR
GPQANYU + Cohere + Anthropic (2023)65.8%SR
LiveCodeBench53.8%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Language
80
Legal
80
Finance
80
Healthcare
80
Code
80
Creativity
80
Writing
80
Chat
70
Math
70
Reasoning
70
General
70
Instruction Following
60
Physics
60
Structured Output
60
Biology
60
Chemistry
60
Factuality
0

Pricing

Input Price$0.125 / 1M tokens
Output Price$0.5 / 1M tokens
Blended Price (3:1)$0.0875 / 1M tokens

Speed

Tokens/sec37.0
Time to First Token2.51s
Time to Answer2.51s

Provider Price Ranking

Provider Price Ranking

6 providers

Cheapest: Kilo GatewayMost Expensive: Azure
ProviderInputOutput
1Kilo GatewayCheapest
$0.056
$0.112
2DeepInfra
$0.07
$0.14
3OpenRouter
$0.07
$0.14
4MicrosoftPRIMARY
$0.125
$0.5
5Azure Cognitive Services
$0.125
$0.5
6Azure
$0.125
$0.5

Compare pricing across different API providers for this model.

External Sources