GPT-4.1 vs Qwen3 235B-A22B

Change models
GPT-4.1OpenAI
IndexAll categories, out of 100.
38.0 ±3.0
38.1 ±8.8 best
GapIndex points below the top.
−0.1 · no clear gap
Top
CoverageIndex weight that has results.
100% best
55%
SpeedOutput tokens per second.
74/s best
44/s
EloLMArena rating and rank.
1383 best
1366
ReleasedMonth of release.
2025-04
2025-04
Input / 1MUS dollars per 1M input tokens.
$2.00
$0.455 best
Output / 1MUS dollars per 1M output tokens.
$8.00
$1.82 best
Batch output / 1MBatch price per 1M output tokens.
$4.00
—
1K chats2K tokens in, 500 out, each.
$8.00
$1.82 best
1K documents20K tokens in, 1K out, each.
$48.00
$10.92 best
1K agent tasks200K tokens in, 20K out, each.
$560.00
$127.40 best
ContextMaximum tokens in one request.
1.05M best
131K
AgenticMulti-step tasks with tools.
37.8
—
CodingCode writing and repair.
34.2
44.0 best
ReasoningLogic problems and puzzles.
40.4
—
MultimodalTasks with images and text.
42.1
—
KnowledgeFacts and expert knowledge.
41.2 best
41.1
MultilingualTasks in many languages.
45.1 best
42.0
InstructionTasks with strict prompt rules.
34.2 best
30.7
MathMath problems.
35.9 best
32.2

Benchmarks

14 shared
Only GPT-4.1: 45Only Qwen3 235B-A22B: 10
GPT-4.1
Qwen3 235B-A22B
66.9%118 / 217
70.7% best113 / 217
83.1% best58 / 149
80.2%89 / 149
TaxEval v2Finance
75.1% best23 / 143
70.6%89 / 143
54.7%113 / 142
70.6% best86 / 142
66.3% best100 / 141
62.9%108 / 141
65.4%101 / 135
70.2% best92 / 135
MMLU ProKnowledge
80.5%87 / 135
81.2% best82 / 135
AIMEMath
39.6%70 / 95
84.0% best40 / 95
MedQAHealthcare
91.2% best40 / 95
90.6%45 / 95
83.0% best25 / 88
68.9%34 / 88
MGSMMultilingual
87.7%58 / 74
92.5% best17 / 74
87.4% best34 / 70
83.2%46 / 70
0.0%33 / 64
0.0%33 / 64
87.2%33 / 59
94.6% best8 / 59