Skip to main content

Mistral Small (Feb '24)

MistralMistral
Release Date
2024-02-26
Parameters
Context Length
256K
Modalities
image, text

Capability Radar

15
general
12
coding
23
reasoning
19
scienceest.
20
agents
60
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking429
12.0
AA
General Ranking468
17.0
AA
Math Reasoning275
28.0
AA
Science458
17.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA71.2%SR

Code

LiveCodeBench63.6%SR

Creativity

Arena Hard58.3%SR

Finance

MMLU-Pro78.0%SR

General

MMMU-Pro60.0%SR
IFBench48.0%SR

Language

COLLIE62.9%SR

Long Context

AA-LCR71.2%SR

Math

AIME 202583.8%SR

AA Evaluation Indices

Intelligence Index
3.6
Math 500
0.6
Mmlu Pro
0.4
Gpqa
0.3
Scicode
0.1
Livecodebench
0.1
Hle
0.0
Aime
0.0

LLM Stats Category Scores

Legal
80
Math
80
Finance
80
Healthcare
80
Language
70
Long Context
70
Physics
70
Reasoning
70
Biology
70
Chemistry
70
Multimodal
60
General
60
Code
60
Creativity
60
Vision
60
Writing
60
Instruction Following
50

Pricing

Input Price$1 / 1M tokens
Output Price$3 / 1M tokens
Blended Price (3:1)$1.5 / 1M tokens

Speed

Tokens/sec156.0
Time to First Token0.58s
Time to Answer0.58s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1MistralPRIMARY
$1
$3

Compare pricing across different API providers for this model.

External Sources