Skip to main content

Mistral Medium

MistralMistral
Release Date
2023-12-11
Parameters
Context Length
262K
Modalities
image, text

Capability Radar

17
general
10
coding
21
reasoning
21
scienceest.
18
agents
60
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking441
11.0
AA
General Ranking456
20.0
AA
Math Reasoning302
21.0
AA
Science450
18.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA71.2%SR

Code

LiveCodeBench63.6%SR

Creativity

Arena Hard58.3%SR

Finance

MMLU-Pro78.0%SR

General

MMMU-Pro60.0%SR
IFBench48.0%SR

Language

COLLIE62.9%SR

Long Context

AA-LCR71.2%SR

Math

AIME 202583.8%SR

AA Evaluation Indices

Intelligence Index
3.6
Mmlu Pro
0.5
Math 500
0.4
Gpqa
0.3
Scicode
0.1
Livecodebench
0.1
Aime
0.0
Hle
0.0

LLM Stats Category Scores

Legal
80
Math
80
Finance
80
Healthcare
80
Language
70
Long Context
70
Physics
70
Reasoning
70
Biology
70
Chemistry
70
Multimodal
60
General
60
Code
60
Creativity
60
Vision
60
Writing
60
Instruction Following
50

Pricing

Input Price$2.75 / 1M tokens
Output Price$8.1 / 1M tokens
Blended Price (3:1)$4.088 / 1M tokens

Speed

Tokens/sec139.9
Time to First Token0.57s
Time to Answer0.57s

Provider Price Ranking

Provider Price Ranking

8 providers

Cheapest: InferenceMost Expensive: Merge Gateway
ProviderInputOutput
1InferenceCheapest
$0.038
$0.1
2Mistral
$0.1
Free
3Amazon Bedrock
$0.15
$0.35
4NanoGPT
$0.3
$0.9
5Azure Cognitive Services
$0.4
$2
6Azure
$0.4
$2
7routing.run
$0.4
$2
8Merge Gateway
$0.4
$2

Compare pricing across different API providers for this model.

External Sources