Mistral Small 3.1
MistralMistralOpen WeightApache 2.0 · Commercial OK
Description
Mistral Small 3 is a 24B-parameter LLM licensed under Apache-2.0. It focuses on low-latency, high-efficiency instruction following, maintaining performance comparable to larger models. It provides quick, accurate responses for conversational agents, function calling, and domain-specific fine-tuning. Suitable for local inference when quantized, it rivals models 2–3× its size while using significantly fewer compute resources.
Release Date
2025-03-17
Parameters
24.0B
Context Length
33K
Modalities
image, text
Capability Radar
24
general
25
coding
19
reasoning
31
science
21
agents
60
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 465 | 25.0 | AA |
| General Ranking | 497 | 28.0 | AA |
| Multimodal Ranking | 108 | 42.0 | LS |
| Science | 503 | 27.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
MT-Bench
0.83 / 100SR
IFEvalGoogle Research (2023)
82.9%SR
Factuality
SimpleQA
10.4%SR
General
Arena Hard
87.6%SR
MMLU
80.6%SR
TriviaQA
80.5%SR
Wild Bench
52.2%SR
Language
MMLU-Pro
66.8%SR
Math
MATH
69.3%SR
Multimodal
MMMU
59.3%SR
Reasoning
HumanEvalOpenAI (2021)
88.4%SR
MBPP
0.75 / 100SR
GPQANYU + Cohere + Anthropic (2023)
46.0%SR
AA Evaluation Indices
(Artificial Analysis)Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))70.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))65.9
Gpqa(NYU + Cohere + Anthropic (2023))45.4
Ifbench(Google Research (2023))29.9
Scicode(UIUC + Argonne National Lab (2024))27.8
Coding Index(Artificial Analysis)26.3
Terminalbench V2 126.2
Tau2(Sierra + U Toronto + Vector Institute (2025))25.1
Lcr(Artificial Analysis)22.3
Livecodebench(UC Berkeley + MIT + Cornell (2024))21.2
Aime(MAA (Mathematical Association of America))9.3
Terminalbench Hard(Stanford × Laude Institute (2026))7.6
Tau Banking7.4
Intelligence Index(Artificial Analysis)7.1
Hle(Center for AI Safety + Scale AI (2025))4.3
Math Index(Artificial Analysis)3.7
Aime 25(MAA (Mathematical Association of America))3.7
Terminalbench V4 00.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Creativity90
Writing90
Chat80
Instruction Following80
Roleplay80
Structured Output80
Code80
Language70
Legal70
Math70
Reasoning70
Finance70
General70
Healthcare70
Communication70
Physics50
Biology50
Chemistry50
Pricing
Input Price$0.11 / 1M tokens
Output Price$0.17 / 1M tokens
Blended Price (3:1)$0.125 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
2 providers
Cheapest: DeepInfraMost Expensive: Mistral
ProviderInputOutput
1DeepInfraCheapest
$0
$0
2MistralPRIMARY
$0.11
$0.17
Compare pricing across different API providers for this model.