GPT-5.4 mini vs Qwen3.5 397B

Change models
IndexAll categories, out of 100.
54.5 ±2.4 best
53.8 ±2.4
GapIndex points below the top.
Top
−0.7 · no clear gap
CoverageIndex weight that has results.
100%
100%
SpeedOutput tokens per second.
95/s best
59/s
EloLMArena rating and rank.
1412
—
ReleasedMonth of release.
2026-03
2026-02
Input / 1MUS dollars per 1M input tokens.
$0.75
$0.60 best
Output / 1MUS dollars per 1M output tokens.
$4.50
$3.60 best
Batch output / 1MBatch price per 1M output tokens.
$2.25
—
1K chats2K tokens in, 500 out, each.
$3.75
$3.00 best
1K documents20K tokens in, 1K out, each.
$19.50
$15.60 best
1K agent tasks200K tokens in, 20K out, each.
$240.00
$192.00 best
ContextMaximum tokens in one request.
400K best
128K
AgenticMulti-step tasks with tools.
56.1 best
53.3
CodingCode writing and repair.
55.1 best
53.3
ReasoningLogic problems and puzzles.
52.2 best
51.9
MultimodalTasks with images and text.
54.8
55.6 best
KnowledgeFacts and expert knowledge.
53.7
53.8 best
MultilingualTasks in many languages.
57.6 best
55.6
InstructionTasks with strict prompt rules.
52.6
55.6 best
MathMath problems.
53.9 best
53.6

Benchmarks

16 shared
Only GPT-5.4 mini: 59Only Qwen3.5 397B: 53
GPT-5.4 mini
Qwen3.5 397B
28.1%91 / 222
29.0% best85 / 222
77.0%82 / 217
77.3% best77 / 217
10.0% best65 / 214
1.7%109 / 214
87.5%56 / 199
89.3% best45 / 199
93.4%31 / 149
95.6% best18 / 149
73.3%29 / 146
78.8% best6 / 146
88.0%38 / 141
88.4% best36 / 141
52.1% best42 / 114
44.8%74 / 114
73.3%65 / 113
77.3% best40 / 113
41.5% best32 / 77
28.7%52 / 77
76.6%32 / 53
79.0% best19 / 53
MCP AtlasAgentic
57.7% best39 / 52
46.1%47 / 52
60.0% best17 / 41
52.5%26 / 41
72.1% best22 / 37
62.2%31 / 37
28.2% best15 / 30
15.3%21 / 30
ToolathlonAgentic
42.9% best16 / 22
36.3%19 / 22