GPT-4.1 mini vs Llama 4 Maverick

Change models
IndexAll categories, out of 100.
34.5 ±3.7 best
34.4 ±4.7
GapIndex points below the top.
Top
−0.1 · no clear gap
CoverageIndex weight that has results.
95%
95%
SpeedOutput tokens per second.
72/s best
61/s
EloLMArena rating and rank.
1341
—
ReleasedMonth of release.
2025-04
2025-04
Input / 1MUS dollars per 1M input tokens.
$0.40
$0.35 best
Output / 1MUS dollars per 1M output tokens.
$1.60
$1.00 best
Batch output / 1MBatch price per 1M output tokens.
$0.80
—
1K chats2K tokens in, 500 out, each.
$1.60
$1.20 best
1K documents20K tokens in, 1K out, each.
$9.60
$8.00 best
1K agent tasks200K tokens in, 20K out, each.
$112.00
$90.00 best
ContextMaximum tokens in one request.
1.05M best
524K
AgenticMulti-step tasks with tools.
35.3
36.9 best
CodingCode writing and repair.
28.2
37.2 best
ReasoningLogic problems and puzzles.
36.8 best
36.7
MultimodalTasks with images and text.
39.2 best
36.0
KnowledgeFacts and expert knowledge.
36.0 best
34.0
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
33.1 best
29.2
MathMath problems.
36.5 best
28.6

Benchmarks

17 shared
Only GPT-4.1 mini: 26Only Llama 4 Maverick: 2
GPT-4.1 mini
Llama 4 Maverick
5.0% best176 / 222
4.9%180 / 222
44.0%165 / 217
50.0% best154 / 217
65.8%120 / 217
67.0% best117 / 217
0.0%150 / 214
0.0%150 / 214
44.7% best126 / 200
20.6%146 / 200
66.4%141 / 199
67.1% best139 / 199
52.9% best93 / 149
17.8%136 / 149
38.3%111 / 146
43.0% best94 / 146
0.0%101 / 133
0.0%101 / 133
0.0%120 / 131
0.0%120 / 131
3.5%124 / 126
4.4% best123 / 126
0.0%102 / 122
0.0%102 / 122
7.2% best113 / 116
7.1%114 / 116
58.7%93 / 113
62.1% best88 / 113
87.3% best20 / 88
73.0%32 / 88
4.5% best47 / 69
0.7%62 / 69
10.0% best29 / 64
0.0%33 / 64