GPT-5.1 vs Grok 4.20 (Reasoning)

Change models
GPT-5.1OpenAI
IndexAll categories, out of 100.
55.3 ±3.7
55.5 ±5.5 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
95% best
90%
SpeedOutput tokens per second.
50/s
—
EloLMArena rating and rank.
1422
—
ReleasedMonth of release.
2025-11
—
Input / 1MUS dollars per 1M input tokens.
$1.25
—
Output / 1MUS dollars per 1M output tokens.
$10.00
—
Batch output / 1MBatch price per 1M output tokens.
$5.00
—
1K chats2K tokens in, 500 out, each.
$7.50
—
1K documents20K tokens in, 1K out, each.
$35.00
—
1K agent tasks200K tokens in, 20K out, each.
$450.00
—
ContextMaximum tokens in one request.
400K
—
AgenticMulti-step tasks with tools.
52.4 best
48.9
CodingCode writing and repair.
53.5 best
51.6
ReasoningLogic problems and puzzles.
56.4
68.6 best
MultimodalTasks with images and text.
58.4
63.8 best
KnowledgeFacts and expert knowledge.
57.2 best
55.8
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
57.1
—
MathMath problems.
57.5
57.7 best

Benchmarks

18 shared
Only GPT-5.1: 26Only Grok 4.20 (Reasoning): 10
GPT-5.1
Grok 4.20 (Reasoning)
85.7% best20 / 149
77.7%107 / 149
TaxEval v2Finance
74.9% best26 / 143
74.1%41 / 143
86.5% best22 / 142
84.3%39 / 142
86.6%41 / 135
88.6% best34 / 135
MMLU ProKnowledge
86.4% best42 / 135
86.3%43 / 135
CorpFin v2Finance
63.8% best39 / 131
63.7%40 / 131
24.6% best85 / 123
4.1%110 / 123
MedScribeHealthcare
88.1% best14 / 109
63.4%103 / 109
MedCodeHealthcare
52.7% best13 / 106
32.2%90 / 106
61.4% best60 / 97
45.4%86 / 97
AIMEMath
93.3%15 / 95
96.5% best6 / 95
MedQAHealthcare
96.4% best2 / 95
94.5%16 / 95
MMMU ProMultimodal
83.2%33 / 92
83.5% best32 / 92
SWE-benchCoding
69.8%64 / 87
72.2% best56 / 87
44.9% best24 / 66
40.4%32 / 66
IOI v1Coding
21.5%21 / 61
30.2% best16 / 61
73.4% best2 / 53
54.4%37 / 53
55.3% best13 / 51
52.3%24 / 51