Skip to main content
AITier

Devstral Small 2

MistralMistralOpen WeightApache 2.0 · Commercial OK

Description

Devstral Small 1.1 (also called devstral-small-2507) is based on the Mistral-Small-3.1 foundation model and contains approximately 24 billion parameters. It supports a 128k token context window, which allows it to handle multi-file code inputs and long prompts typical in software engineering workflows. The model is fine-tuned specifically for structured outputs, including XML and function-calling formats. This makes it compatible with agent frameworks such as OpenHands and suitable for tasks like program navigation, multi-step edits, and code search. It is licensed under Apache 2.0 and available for both research and commercial use.

Release Date
2025-12-09
Parameters
24.0B
Context Length
256K
Modalities
image, text

Capability Radar

31
general
31
coding
37
reasoning
35
science
35
agents
80
multimodal

Rankings

Domain#RankScoreSource
Code Ranking324
34.0
AA
General Ranking357
36.0
AA
Science390
34.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Code

SWE-Bench Verified53.6%SR

AA Evaluation Indices

(Artificial Analysis)
Math Index(Artificial Analysis)
34.3
Coding Index(Artificial Analysis)
29.3
Intelligence Index(Artificial Analysis)
17.7
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
0.7
Gpqa(NYU + Cohere + Anthropic (2023))
0.5
Livecodebench(UC Berkeley + MIT + Cornell (2024))
0.3
Aime 25(MAA (Mathematical Association of America))
0.3
Ifbench(Google Research (2023))
0.3
Terminalbench V2 1
0.3
Scicode(UIUC + Argonne National Lab (2024))
0.3
Lcr(Artificial Analysis)
0.3
Tau2(Sierra + U Toronto + Vector Institute (2025))
0.2
Terminalbench Hard(Stanford × Laude Institute (2026))
0.2
Tau Banking
0.1
Hle(Center for AI Safety + Scale AI (2025))
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Reasoning
50
Frontend Development
50
General
50
Code
50

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec89.3
Time to First Token0.71s
Time to Answer0.71s

Provider Price Ranking

No provider data available

External Sources

LLM StatsArtificial Analysis