Skip to main content
AITier

Devstral Small 2

MistralMistralOpen WeightApache 2.0 · Commercial OK

Description

Devstral Small 1.1 (also called devstral-small-2507) is based on the Mistral-Small-3.1 foundation model and contains approximately 24 billion parameters. It supports a 128k token context window, which allows it to handle multi-file code inputs and long prompts typical in software engineering workflows. The model is fine-tuned specifically for structured outputs, including XML and function-calling formats. This makes it compatible with agent frameworks such as OpenHands and suitable for tasks like program navigation, multi-step edits, and code search. It is licensed under Apache 2.0 and available for both research and commercial use.

Release Date
2025-12-09
Parameters
24.0B
Context Length
256K
Modalities
image, text

Capability Radar

25
general
32
coding
37
reasoning
36
science
36
agents
80
multimodal

Rankings

Domain#RankScoreSource
Code Ranking412
33.0
AA
General Ranking495
28.0
AA
Science456
32.0
AA

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Reasoning

SWE-Bench Verified53.6%SR

AA Evaluation Indices

(Artificial Analysis)
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))
67.8
Gpqa(NYU + Cohere + Anthropic (2023))
53.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))
34.8
Aime 25(MAA (Mathematical Association of America))
34.3
Math Index(Artificial Analysis)
34.3
Scicode(UIUC + Argonne National Lab (2024))
32.4
Ifbench(Google Research (2023))
31.2
Terminalbench V2 1
29.6
Coding Index(Artificial Analysis)
29.3
Lcr(Artificial Analysis)
28.0
Tau2(Sierra + U Toronto + Vector Institute (2025))
23.4
Terminalbench Hard(Stanford × Laude Institute (2026))
16.7
Tau Banking
10.7
Intelligence Index(Artificial Analysis)
7.5
Hle(Center for AI Safety + Scale AI (2025))
3.5
Terminalbench V4 0
0.0

LLM Stats Category Scores

(LLM Stats (zeroeval))
Reasoning
50
Frontend Development
50
General
50
Code
50

Pricing

Input PriceFree
Output PriceFree
Blended Price (3:1)Free

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Pioneer
$0.1
$0.3

Compare pricing across different API providers for this model.

External Sources

LLM StatsArtificial Analysis