Claude 3.5 Haiku vs Mistral Small 3.1
Change modelsClaude 3.5 HaikuAnthropic
Mistral Small 3.1Mistral
IndexAll categories, out of 100.
24.1 ±3.4
24.2 ±4.1 best
GapIndex points below the top.
−0.1 · no clear gap
Top
CoverageIndex weight that has results.
100% best
95%
SpeedOutput tokens per second.
—
28/s
EloLMArena rating and rank.
1255
—
ReleasedMonth of release.
2024-10
2025-03
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
200K best
128K
AgenticMulti-step tasks with tools.
26.6
26.7 best
CodingCode writing and repair.
28.0 best
25.6
ReasoningLogic problems and puzzles.
31.4 best
29.7
MultimodalTasks with images and text.
14.5
28.8 best
KnowledgeFacts and expert knowledge.
24.4
25.7 best
MultilingualTasks in many languages.
31.1
—
InstructionTasks with strict prompt rules.
32.6 best
17.0
MathMath problems.
16.2
16.7 best
Benchmarks
24 sharedOnly Claude 3.5 Haiku: 9Only Mistral Small 3.1: 7
Claude 3.5 Haiku
Mistral Small 3.1