Skip to main content

Phi-4 Multimodal Instruct

MicrosoftPhiOpen WeightMIT · Commercial OK

Description

Phi-4-multimodal-instruct is a lightweight (5.57B parameters) open multimodal foundation model that leverages research and datasets from Phi-3.5 and 4.0. It processes text, image, and audio inputs to generate text outputs, supporting a 128K token context length. Enhanced via SFT, DPO, and RLHF for instruction following and safety.

Release Date
2025-02-26
Parameters
5.6B
Context Length
Modalities
image, text

Capability Radar

18
general
13
coding
32
reasoning
19
science
26
agents
85
multimodal

Rankings

Domain#RankScoreSource
Code Ranking475
14.0
AA
General Ranking508
20.0
AA
Multimodal Ranking76
30.0
LS
Science517
17.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

3d

BLINK61.3%SR

General

MMMU55.1%SR
MMMU-Pro38.5%SR

Image To Text

DocVQADocVQA (2020)93.2%SR
OCRBench84.4%SR
TextVQA75.6%SR

Math

MathVista62.4%SR
InterGPS48.6%SR

Multimodal

ScienceQA Visual97.5%SR
MMBench86.7%SR
POPE85.6%SR
AI2D82.3%SR
ChartQAMasry et al. (2022)81.4%SR
InfoVQA72.7%SR
Video-MME55.0%SR

AA Evaluation Indices

(Artificial Analysis)
Intelligence Index(Artificial Analysis)
4.2
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
0.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.5
Gpqa(NYU + Cohere + Anthropic (2023))
0.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.1
Scicode(UIUC + Argonne National Lab (2024))
0.1
Aime(MAA (Mathematical Association of America))
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.1

LLM Stats Category Scores

(LLM Stats (zeroeval))
Safety
90
Image To Text
80
Multimodal
70
Reasoning
70
General
70
Vision
70
Math
60
Spatial Reasoning
60
Healthcare
60
3d
60

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec17.3
Time to First Token0.37s
Time to Answer0.37s

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: Azure Cognitive ServicesMost Expensive: Azure
ProviderInputOutput
1Azure Cognitive ServicesCheapest
$0.08
$0.32
2Azure
$0.08
$0.32

Compare pricing across different API providers for this model.

External Sources