Grok 2 vs Llama 3.3 70B

Change models
IndexAll categories, out of 100.
29.1 ±9.4 best
28.2 ±5.3
GapIndex points below the top.
Top
−0.9 · no clear gap
CoverageIndex weight that has results.
55%
90% best
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1305
—
ReleasedMonth of release.
2024-08
2024-12
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
—
128K
AgenticMulti-step tasks with tools.
—
27.2
CodingCode writing and repair.
25.2
28.9 best
ReasoningLogic problems and puzzles.
—
27.5
MultimodalTasks with images and text.
33.5
—
KnowledgeFacts and expert knowledge.
34.0 best
29.1
MultilingualTasks in many languages.
—
34.1
InstructionTasks with strict prompt rules.
—
40.9
MathMath problems.
25.0 best
15.6

Benchmarks

7 shared
Only Grok 2: 12Only Llama 3.3 70B: 9
Grok 2
Llama 3.3 70B
53.8% best139 / 217
47.4%155 / 217
11.5% best153 / 200
5.1%169 / 200
56.0% best118 / 141
50.5%122 / 141
63.5% best39 / 88
41.6%57 / 88
75.5% best50 / 75
68.9%57 / 75
87.5% best10 / 34
86.0%16 / 34
88.4%8 / 22
88.4%8 / 22