Devstral Medium
MistralMistralProprietary
Description
Devstral Medium builds upon the strengths of Devstral Small and takes performance to the next level with a score of 61.6% on SWE-Bench Verified. Devstral Medium is available through the Mistral public API, and offers exceptional performance at a competitive price point, making it an ideal choice for businesses and developers looking for a high-quality, cost-effective model.
Release Date
2025-07-10
Parameters
—
Context Length
128K
Modalities
text
Capability Radar
29
general
33
coding
20
reasoning
33
science
24
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 350 | 30.0 | AA |
| General Ranking | 405 | 32.0 | AA |
| Science | 406 | 33.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Code
SWE-Bench Verified
61.6%SR
AA Evaluation Indices
(Artificial Analysis)Intelligence Index(Artificial Analysis)12.4
Math Index(Artificial Analysis)4.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.7
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.5
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.3
Lcr(Artificial Analysis)0.3
Ifbench(Google Research (2023))0.3
Scicode(UIUC + Argonne National Lab (2024))0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))0.2
Terminalbench Hard(Stanford × Laude Institute (2026))0.1
Aime(MAA (Mathematical Association of America))0.1
Aime 25(MAA (Mathematical Association of America))0.0
Hle(Center for AI Safety + Scale AI (2025))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))Reasoning60
Frontend Development60
General60
Code60
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
1 providers
ProviderInputOutput
1Mistral
$0.4
$2
Compare pricing across different API providers for this model.