GPT-4o vs Llama 3.3 70B

Change models
GPT-4oOpenAI
IndexAll categories, out of 100.
28.7 ±3.3 best
28.2 ±5.3
GapIndex points below the top.
Top
−0.5 · no clear gap
CoverageIndex weight that has results.
100% best
90%
SpeedOutput tokens per second.
66/s
—
EloLMArena rating and rank.
1300
—
ReleasedMonth of release.
2024-05
2024-12
Input / 1MUS dollars per 1M input tokens.
$2.50
—
Output / 1MUS dollars per 1M output tokens.
$10.00
—
Batch output / 1MBatch price per 1M output tokens.
$5.00
—
1K chats2K tokens in, 500 out, each.
$10.00
—
1K documents20K tokens in, 1K out, each.
$60.00
—
1K agent tasks200K tokens in, 20K out, each.
$700.00
—
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
26.7
27.2 best
CodingCode writing and repair.
22.8
28.9 best
ReasoningLogic problems and puzzles.
37.4 best
27.5
MultimodalTasks with images and text.
36.0
—
KnowledgeFacts and expert knowledge.
34.1 best
29.1
MultilingualTasks in many languages.
30.8
34.1 best
InstructionTasks with strict prompt rules.
21.1
40.9 best
MathMath problems.
23.4 best
15.6

Benchmarks

10 shared
Only GPT-4o: 32Only Llama 3.3 70B: 6
GPT-4o
Llama 3.3 70B
2.4%222 / 222
3.6% best210 / 222
49.3% best158 / 217
15.7%196 / 217
48.9% best149 / 217
47.4%155 / 217
0.0%150 / 214
0.0%150 / 214
6.3% best166 / 200
5.1%169 / 200
54.3% best169 / 199
49.8%174 / 199
25.1%120 / 149
26.6% best116 / 149
34.3%125 / 146
47.1% best84 / 146
0.0%101 / 133
0.0%101 / 133
51.0% best48 / 88
41.6%57 / 88