GPT-4.1 mini vs Nemotron Ultra 253B

Change models
IndexAll categories, out of 100.
34.5 ±3.7
35.9 ±6.9 best
GapIndex points below the top.
−1.4 · no clear gap
Top
CoverageIndex weight that has results.
95% best
85%
SpeedOutput tokens per second.
72/s
—
EloLMArena rating and rank.
1341
—
ReleasedMonth of release.
2025-04
2025-04
Input / 1MUS dollars per 1M input tokens.
$0.40
—
Output / 1MUS dollars per 1M output tokens.
$1.60
—
Batch output / 1MBatch price per 1M output tokens.
$0.80
—
1K chats2K tokens in, 500 out, each.
$1.60
—
1K documents20K tokens in, 1K out, each.
$9.60
—
1K agent tasks200K tokens in, 20K out, each.
$112.00
—
ContextMaximum tokens in one request.
1.05M best
32K
AgenticMulti-step tasks with tools.
35.3 best
10.4
CodingCode writing and repair.
28.2
44.4 best
ReasoningLogic problems and puzzles.
36.8
36.8
MultimodalTasks with images and text.
39.2
—
KnowledgeFacts and expert knowledge.
36.0
38.6 best
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
33.1
34.0 best
MathMath problems.
36.5
42.5 best

Benchmarks

7 shared
Only GPT-4.1 mini: 36Only Nemotron Ultra 253B: 3
GPT-4.1 mini
Nemotron Ultra 253B
5.0%176 / 222
7.4% best158 / 222
0.0%150 / 214
0.0%150 / 214
66.4%141 / 199
72.8% best128 / 199
52.9% best93 / 149
11.4%144 / 149
38.3% best111 / 146
38.2%112 / 146
64.2%105 / 141
76.0% best76 / 141
88.5%31 / 70
89.5% best28 / 70