Claude 3.5 Sonnet vs Magistral Small

Change models
IndexAll categories, out of 100.
32.2 ±9.2 best
31.4 ±4.3
GapIndex points below the top.
Top
−0.8 · no clear gap
CoverageIndex weight that has results.
55%
95% best
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1298
—
ReleasedMonth of release.
2024-06
2025-06
Input / 1MUS dollars per 1M input tokens.
$3.00
—
Output / 1MUS dollars per 1M output tokens.
$15.00
—
1K chats2K tokens in, 500 out, each.
$13.50
—
1K documents20K tokens in, 1K out, each.
$75.00
—
1K agent tasks200K tokens in, 20K out, each.
$900.00
—
ContextMaximum tokens in one request.
200K best
128K
AgenticMulti-step tasks with tools.
—
24.8
CodingCode writing and repair.
34.0
36.3 best
ReasoningLogic problems and puzzles.
—
28.2
MultimodalTasks with images and text.
44.7 best
40.0
KnowledgeFacts and expert knowledge.
37.4 best
31.0
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
—
12.2
MathMath problems.
25.2
41.3 best

Benchmarks

11 shared
Only Claude 3.5 Sonnet: 16Only Magistral Small: 18
Claude 3.5 Sonnet
Magistral Small
TaxEval v2Finance
70.2% best93 / 143
60.3%128 / 143
49.6%117 / 142
72.1% best83 / 142
59.4%111 / 141
68.2% best97 / 141
59.3% best110 / 135
58.3%112 / 135
MMLU ProKnowledge
78.4% best103 / 135
62.1%132 / 135
CorpFin v2Finance
53.6% best98 / 131
44.0%119 / 131
64.1% best48 / 97
62.1%57 / 97
AIMEMath
10.0%88 / 95
80.7% best47 / 95
MedQAHealthcare
83.2% best64 / 95
82.4%66 / 95
MMMU ProMultimodal
68.8% best72 / 92
65.2%76 / 92
MGSMMultilingual
92.6% best15 / 74
86.3%62 / 74