Claude 3.7 Sonnet Thinking vs Grok Code Fast 1

Change models
IndexAll categories, out of 100.
41.4 ±4.7 best
41.2 ±7.4
GapIndex points below the top.
Top
−0.2 · no clear gap
CoverageIndex weight that has results.
95% best
75%
SpeedOutput tokens per second.
—
172/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2025-02
2025-08
Input / 1MUS dollars per 1M input tokens.
—
$0.20
Output / 1MUS dollars per 1M output tokens.
—
$1.50
1K chats2K tokens in, 500 out, each.
—
$1.15
1K documents20K tokens in, 1K out, each.
—
$5.50
1K agent tasks200K tokens in, 20K out, each.
—
$70.00
ContextMaximum tokens in one request.
200K
256K best
AgenticMulti-step tasks with tools.
39.1
42.9 best
CodingCode writing and repair.
39.5
45.5 best
ReasoningLogic problems and puzzles.
38.6
40.3 best
MultimodalTasks with images and text.
48.1
—
KnowledgeFacts and expert knowledge.
44.1 best
38.9
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
42.5 best
27.7
MathMath problems.
36.6
—

Benchmarks

7 shared
Only Claude 3.7 Sonnet Thinking: 17Only Grok Code Fast 1: 4
Claude 3.7 Sonnet Thinking
Grok Code Fast 1
9.7% best148 / 222
8.0%153 / 222
0.9% best124 / 214
0.0%150 / 214
77.2% best107 / 199
72.7%129 / 199
28.0% best87 / 164
23.5%112 / 164
54.7%91 / 149
75.7% best74 / 149
48.3% best82 / 146
41.4%100 / 146
60.4%106 / 142
62.0% best105 / 142