Skip to main content

Phi-3.5-vision-instruct

MicrosoftPhiOpen WeightMIT · Commercial OK

Description

Phi-3.5-vision-instruct is a 4.2B-parameter open multimodal model with up to 128K context tokens. It emphasizes multi-frame image understanding and reasoning, boosting performance on single-image benchmarks while enabling multi-image comparison, summarization, and even video analysis. The model underwent safety post-training for improved instruction-following, alignment, and robust handling of visual and text inputs, and is released under the MIT license.

Release Date
2024-08-23
Parameters
4.2B
Context Length
—
Modalities
—

Capability Radar

70
general
0
coding
40
reasoning
34
scienceest.
28
agents
70
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

Domain#RankScoreSource
Multimodal Ranking135
29.0
LS

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Math

MathVista43.9%SR
InterGPS36.3%SR

Multimodal

MMMU43.0%SR

Reasoning

ScienceQA91.3%SR
ChartQAMasry et al. (2022)81.8%SR

Vision

POPE86.1%SR
MMBench81.9%SR
AI2D78.1%SR
TextVQA72.0%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Safety
90
Image To Text
70
Multimodal
70
Reasoning
70
General
70
Vision
70
Math
40
Healthcare
40

Pricing

No pricing data available

Speed

No speed data available

Provider Price Ranking

No provider data available

External Sources