Skip to main content

Mistral Small (Sep '24)

MistralMistralOpen WeightApache 2.0 · Commercial OK

Description

Mistral Small 4 is Mistral AI's hybrid small model that unifies instruct, reasoning, multimodal understanding, and coding capabilities in a single efficient system. It uses a 119B-parameter Mixture-of-Experts architecture with native image input, a 256k context window, and configurable reasoning depth for general chat, coding agents, and long-context reasoning workloads.

Release Date
2024-09-17
Parameters
119.0B
Context Length
256K
Modalities
image, text

Capability Radar

20
general
14
coding
28
reasoning
28
science
24
agents
60
multimodal

Rankings

Domain#RankScoreSource
Code Ranking550
15.0
AA
General Ranking556
22.0
AA
Multimodal Ranking112
41.0
LS
Science578
19.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

General

MMLU80.7%SR
TriviaQA80.3%SR
Arena Hard58.3%SR

Instruction Following

IFBench48.0%SR

Language

MMLU-Pro78.0%SR
COLLIE62.9%SR

Math

AIME 202583.8%SR
GSM8k80.7%SR
MATH46.0%SR

Reasoning

ARC-C91.3%SR
GPQANYU + Cohere + Anthropic (2023)71.2%SR
AA-LCR71.2%SR
MBPP0.70 / 100SR
AGIEval65.8%SR
LiveCodeBench63.6%SR

Vision

MMMU-Pro60.0%SR

AA Evaluation Indices

(Artificial Analysis)
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))
56.3
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
52.9
Gpqa(NYU + Cohere + Anthropic (2023))
38.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))
14.1
Aime(MAA (Mathematical Association of America))
6.3
Intelligence Index(Artificial Analysis)
5.8
Hle(Center for AI Safety + Scale AI (2025))
4.3

LLM Stats Category Scores

(LLM Stats (zeroeval))
Legal
80
Math
80
Finance
80
Healthcare
80
Language
70
Long Context
70
Physics
70
Reasoning
70
General
70
Biology
70
Chemistry
70
Chat
60
Multimodal
60
Code
60
Creativity
60
Vision
60
Writing
60
Instruction Following
50

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Cache Read Price$0.015 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: Mistral AIMost Expensive: Helicone
ProviderInputOutput
1Mistral AICheapest
$0
$0
2Helicone
$0.075
$0.2

Compare pricing across different API providers for this model.

External Sources