o4-mini vs Qwen3 Max

Change models
o4-miniOpenAI
Qwen3 MaxAlibaba
IndexAll categories, out of 100.
44.7 ±3.0
45.0 ±5.1 best
GapIndex points below the top.
−0.3 · no clear gap
Top
CoverageIndex weight that has results.
100% best
85%
SpeedOutput tokens per second.
122/s best
62/s
EloLMArena rating and rank.
1353
1413 best
ReleasedMonth of release.
2025-04
2025-09
Input / 1MUS dollars per 1M input tokens.
$1.10
$0.78 best
Output / 1MUS dollars per 1M output tokens.
$4.40
$3.90 best
1K chats2K tokens in, 500 out, each.
$4.40
$3.51 best
1K documents20K tokens in, 1K out, each.
$26.40
$19.50 best
1K agent tasks200K tokens in, 20K out, each.
$308.00
$234.00 best
ContextMaximum tokens in one request.
200K
262K best
AgenticMulti-step tasks with tools.
38.5
47.1 best
CodingCode writing and repair.
45.2
46.3 best
ReasoningLogic problems and puzzles.
44.9 best
40.3
MultimodalTasks with images and text.
52.0
—
KnowledgeFacts and expert knowledge.
40.8
48.1 best
MultilingualTasks in many languages.
35.5
—
InstructionTasks with strict prompt rules.
53.2 best
30.2
MathMath problems.
50.5 best
46.3

Benchmarks

28 shared
Only o4-mini: 28Only Qwen3 Max: 6
o4-mini
Qwen3 Max
16.5% best122 / 222
11.9%136 / 222
61.0% best141 / 217
50.0%154 / 217
79.6% best91 / 217
72.6%110 / 217
0.6% best132 / 214
0.0%150 / 214
81.7% best83 / 200
73.3%94 / 200
78.4% best103 / 199
76.4%112 / 199
24.8% best106 / 164
24.4%107 / 164
79.2%97 / 149
81.9% best78 / 149
55.6%89 / 149
74.3% best76 / 149
68.7% best51 / 146
44.1%89 / 146
TaxEval v2Finance
74.8% best29 / 143
74.0%42 / 143
82.2% best53 / 142
78.2%76 / 142
74.5%83 / 135
79.5% best69 / 135
MMLU ProKnowledge
80.6%86 / 135
84.4% best62 / 135
CorpFin v2Finance
59.0% best79 / 131
55.9%91 / 131
MedScribeHealthcare
69.1%97 / 109
72.7% best87 / 109
MedCodeHealthcare
33.8% best83 / 106
31.4%93 / 106
AIMEMath
83.7% best41 / 95
81.0%46 / 95
MedQAHealthcare
96.0% best8 / 95
87.4%57 / 95
18.8%80 / 91
48.7% best33 / 91