Grok 3 Mini vs o1

Change models
o1OpenAI
IndexAll categories, out of 100.
44.3 ±9.7
44.5 ±4.1 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
60%
95% best
SpeedOutput tokens per second.
65/s
97/s best
EloLMArena rating and rank.
1370 best
1366
ReleasedMonth of release.
2025-02
2024-12
Input / 1MUS dollars per 1M input tokens.
$0.30 best
$15.00
Output / 1MUS dollars per 1M output tokens.
$0.50 best
$60.00
1K chats2K tokens in, 500 out, each.
$0.85 best
$60.00
1K documents20K tokens in, 1K out, each.
$6.50 best
$360.00
1K agent tasks200K tokens in, 20K out, each.
$70.00 best
$4,200.00
ContextMaximum tokens in one request.
128K
200K best
AgenticMulti-step tasks with tools.
—
44.3
CodingCode writing and repair.
51.4 best
31.0
ReasoningLogic problems and puzzles.
37.0
43.6 best
MultimodalTasks with images and text.
—
55.9
KnowledgeFacts and expert knowledge.
48.7 best
46.8
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
—
51.8
MathMath problems.
43.9
43.9

Benchmarks

6 shared
Only Grok 3 Mini: 7Only o1: 23
Grok 3 Mini
o1
75.5%106 / 217
76.8% best99 / 217
77.8% best90 / 200
73.3%94 / 200
80.3% best65 / 141
75.7%77 / 141
88.1%18 / 88
94.7% best12 / 88
5.9%43 / 69
9.3% best38 / 69
0.0%33 / 64
0.0%33 / 64