Phi-4 Multimodal Instruct
MicrosoftPhiOpen WeightMIT · Commercial OK
Description
Phi-4-multimodal-instruct is a lightweight (5.57B parameters) open multimodal foundation model that leverages research and datasets from Phi-3.5 and 4.0. It processes text, image, and audio inputs to generate text outputs, supporting a 128K token context length. Enhanced via SFT, DPO, and RLHF for instruction following and safety.
Release Date
2025-02-26
Parameters
5.6B
Context Length
—
Modalities
image, text
Capability Radar
18
general
13
coding
32
reasoning
19
scienceest.
26
agents
85
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 416 | 14.0 | AA |
| General Ranking | 440 | 21.0 | AA |
| Math Reasoning | 228 | 39.0 | AA |
| Multimodal Ranking | 28 | 82.0 | LS |
| Science | 453 | 17.0 | AA |
Benchmark Scores (LLM Stats)
3d
BLINK
61.3%SR
General
MMMU
55.1%SR
MMMU-Pro
38.5%SR
Image To Text
DocVQA
93.2%SR
OCRBench
84.4%SR
TextVQA
75.6%SR
Math
MathVista
62.4%SR
InterGPS
48.6%SR
Multimodal
ScienceQA Visual
97.5%SR
MMBench
86.7%SR
POPE
85.6%SR
AI2D
82.3%SR
ChartQA
81.4%SR
InfoVQA
72.7%SR
Video-MME
55.0%SR
AA Evaluation Indices
Intelligence Index4.5
Math 5000.7
Mmlu Pro0.5
Gpqa0.3
Livecodebench0.1
Scicode0.1
Aime0.1
Hle0.0
LLM Stats Category Scores
Image To Text80
Multimodal70
Reasoning70
Vision70
Math60
Spatial Reasoning60
Healthcare60
3d60
General50
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec16.0
Time to First Token1.34s
Time to Answer1.34s
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: NanoGPTMost Expensive: evroc
ProviderInputOutput
1NanoGPTCheapest
$0.07
$0.11
2Azure Cognitive Services
$0.08
$0.32
3Azure
$0.08
$0.32
4evroc
$0.24
$0.47
Compare pricing across different API providers for this model.