Claude 3.7 Sonnet vs Mistral Small 4

Change models
IndexAll categories, out of 100.
37.7 ±4.0
37.9 ±6.2 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
95% best
85%
SpeedOutput tokens per second.
—
114/s
EloLMArena rating and rank.
1299
—
ReleasedMonth of release.
2025-02
2026-03
Input / 1MUS dollars per 1M input tokens.
—
$0.15
Output / 1MUS dollars per 1M output tokens.
—
$0.60
Batch output / 1MBatch price per 1M output tokens.
—
$0.30
1K chats2K tokens in, 500 out, each.
—
$0.60
1K documents20K tokens in, 1K out, each.
—
$3.60
1K agent tasks200K tokens in, 20K out, each.
—
$42.00
ContextMaximum tokens in one request.
200K
262K best
AgenticMulti-step tasks with tools.
40.7 best
33.6
CodingCode writing and repair.
42.1
44.3 best
ReasoningLogic problems and puzzles.
39.8 best
39.4
MultimodalTasks with images and text.
40.3 best
29.1
KnowledgeFacts and expert knowledge.
40.0 best
39.9
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
38.1 best
34.1
MathMath problems.
30.0
—

Benchmarks

8 shared
Only Claude 3.7 Sonnet: 34Only Mistral Small 4: 5
Claude 3.7 Sonnet
Mistral Small 4
4.2%194 / 222
9.9% best145 / 222
51.7% best153 / 217
49.7%157 / 217
0.0%150 / 214
0.3% best137 / 214
65.6%142 / 199
76.9% best109 / 199
28.2% best84 / 164
21.4%124 / 164
50.0% best96 / 149
41.2%104 / 149
44.0%90 / 146
48.2% best83 / 146
60.1% best92 / 113
56.8%94 / 113