Llama 3.1 405B vs Llama 4 Scout

Change models
IndexAll categories, out of 100.
27.0 ±8.9 best
26.8 ±4.8
GapIndex points below the top.
Top
−0.2 · no clear gap
CoverageIndex weight that has results.
65%
95% best
SpeedOutput tokens per second.
29/s
63/s best
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2024-07
2025-04
Input / 1MUS dollars per 1M input tokens.
—
$0.10
Output / 1MUS dollars per 1M output tokens.
—
$0.30
1K chats2K tokens in, 500 out, each.
—
$0.35
1K documents20K tokens in, 1K out, each.
—
$2.30
1K agent tasks200K tokens in, 20K out, each.
—
$26.00
ContextMaximum tokens in one request.
128K
1.31M best
AgenticMulti-step tasks with tools.
15.4
23.6 best
CodingCode writing and repair.
—
23.6
ReasoningLogic problems and puzzles.
30.8
32.4 best
MultimodalTasks with images and text.
—
24.0
KnowledgeFacts and expert knowledge.
26.3
28.0 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
33.5 best
25.9
MathMath problems.
18.9
24.2 best

Benchmarks

9 shared
Only Llama 3.1 405B: 1Only Llama 4 Scout: 9
Llama 3.1 405B
Llama 4 Scout
4.0% best201 / 222
3.8%202 / 222
25.3%189 / 217
27.7% best184 / 217
50.9%143 / 217
51.8% best141 / 217
0.0%150 / 214
0.0%150 / 214
9.7% best155 / 200
7.8%160 / 200
51.5%170 / 199
58.7% best160 / 199
19.0% best134 / 149
15.5%139 / 149
39.0%108 / 146
39.5% best106 / 146
49.8%49 / 88
62.3% best41 / 88