Devstral Small vs Mistral Medium 3

Change models
IndexAll categories, out of 100.
28.2 ±8.2 best
27.1 ±5.2
GapIndex points below the top.
Top
−1.1 · no clear gap
CoverageIndex weight that has results.
75%
95% best
SpeedOutput tokens per second.
—
94/s
EloLMArena rating and rank.
—
1370
ReleasedMonth of release.
2025-05
2025-05
Input / 1MUS dollars per 1M input tokens.
—
$0.40
Output / 1MUS dollars per 1M output tokens.
—
$2.00
1K chats2K tokens in, 500 out, each.
—
$1.80
1K documents20K tokens in, 1K out, each.
—
$10.00
1K agent tasks200K tokens in, 20K out, each.
—
$120.00
ContextMaximum tokens in one request.
128K
131K best
AgenticMulti-step tasks with tools.
21.6 best
18.9
CodingCode writing and repair.
35.7 best
9.3
ReasoningLogic problems and puzzles.
28.5
32.8 best
MultimodalTasks with images and text.
—
24.1
KnowledgeFacts and expert knowledge.
24.2
31.1 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
21.4
25.7 best
MathMath problems.
—
32.2

Benchmarks

7 shared
Only Devstral Small: 1Only Mistral Medium 3: 7
Devstral Small
Mistral Medium 3
3.8%202 / 222
4.1% best199 / 222
18.7%194 / 217
31.3% best179 / 217
0.0%150 / 214
0.0%150 / 214
41.4%189 / 199
57.8% best161 / 199
14.7%153 / 164
18.3% best139 / 164
28.4% best115 / 149
24.3%124 / 149
34.6%123 / 146
39.3% best107 / 146