GPT-4.1 nano vs Llama 3.1 405B
Change modelsGPT-4.1 nanoOpenAI
Llama 3.1 405BMeta
IndexAll categories, out of 100.
26.3 ±3.9
27.0 ±8.9 best
GapIndex points below the top.
−0.7 · no clear gap
Top
CoverageIndex weight that has results.
95% best
65%
SpeedOutput tokens per second.
56/s best
29/s
EloLMArena rating and rank.
1285
—
ReleasedMonth of release.
2025-04
2024-07
Input / 1MUS dollars per 1M input tokens.
$0.10
—
Output / 1MUS dollars per 1M output tokens.
$0.40
—
Batch output / 1MBatch price per 1M output tokens.
$0.20
—
1K chats2K tokens in, 500 out, each.
$0.40
—
1K documents20K tokens in, 1K out, each.
$2.40
—
1K agent tasks200K tokens in, 20K out, each.
$28.00
—
ContextMaximum tokens in one request.
1.05M best
128K
AgenticMulti-step tasks with tools.
24.2 best
15.4
CodingCode writing and repair.
24.8
—
ReasoningLogic problems and puzzles.
31.6 best
30.8
MultimodalTasks with images and text.
17.1
—
KnowledgeFacts and expert knowledge.
26.7 best
26.3
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
24.8
33.5 best
MathMath problems.
29.1 best
18.9
Benchmarks
10 sharedOnly GPT-4.1 nano: 25
GPT-4.1 nano
Llama 3.1 405B