Claude 3.5 Haiku vs Claude 3.7 Sonnet Thinking

Change models
IndexAll categories, out of 100.
24.1 ±3.4
41.4 ±4.7 best
GapIndex points below the top.
−17.3
Top
CoverageIndex weight that has results.
100% best
95%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1255
—
ReleasedMonth of release.
2024-10
2025-02
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
200K
200K
AgenticMulti-step tasks with tools.
26.6
39.1 best
CodingCode writing and repair.
28.0
39.5 best
ReasoningLogic problems and puzzles.
31.4
38.6 best
MultimodalTasks with images and text.
14.5
48.1 best
KnowledgeFacts and expert knowledge.
24.4
44.1 best
MultilingualTasks in many languages.
31.1
—
InstructionTasks with strict prompt rules.
32.6
42.5 best
MathMath problems.
16.2
36.6 best

Benchmarks

18 shared
Only Claude 3.5 Haiku: 15Only Claude 3.7 Sonnet Thinking: 6
Claude 3.5 Haiku
Claude 3.7 Sonnet Thinking
3.6%210 / 222
9.7% best148 / 222
0.0%150 / 214
0.9% best124 / 214
40.8%190 / 199
77.2% best107 / 199
13.2%157 / 164
28.0% best87 / 164
70.3%123 / 149
82.5% best69 / 149
24.6%122 / 149
54.7% best91 / 149
42.8%97 / 146
48.3% best82 / 146
TaxEval v2Finance
57.4%135 / 143
74.0% best42 / 143
41.9%127 / 142
60.4% best106 / 142
41.6%131 / 141
78.2% best72 / 141
37.9%129 / 135
75.3% best81 / 135
MMLU ProKnowledge
64.1%129 / 135
82.7% best76 / 135
CorpFin v2Finance
50.8%106 / 131
60.4% best68 / 131
AIMEMath
3.3%93 / 95
44.6% best64 / 95
MGSMMultilingual
84.6%68 / 74
93.0% best11 / 74
85.9%37 / 70
93.2% best15 / 70
64.2%56 / 59
91.6% best21 / 59
5.3%27 / 27
61.3% best21 / 27