Magistral Medium vs o1-mini

Change models
o1-miniOpenAI
IndexAll categories, out of 100.
33.7 ±4.1 best
33.5 ±8.2
GapIndex points below the top.
Top
−0.2 · no clear gap
CoverageIndex weight that has results.
95% best
65%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
1255
1317 best
ReleasedMonth of release.
2025-06
2024-09
Input / 1MUS dollars per 1M input tokens.
—
$1.10
Output / 1MUS dollars per 1M output tokens.
—
$4.40
1K chats2K tokens in, 500 out, each.
—
$4.40
1K documents20K tokens in, 1K out, each.
—
$26.40
1K agent tasks200K tokens in, 20K out, each.
—
$308.00
ContextMaximum tokens in one request.
40K
128K best
AgenticMulti-step tasks with tools.
30.6
—
CodingCode writing and repair.
39.2 best
32.7
ReasoningLogic problems and puzzles.
28.4
36.5 best
MultimodalTasks with images and text.
39.2
—
KnowledgeFacts and expert knowledge.
35.2 best
28.2
MultilingualTasks in many languages.
—
33.4
InstructionTasks with strict prompt rules.
12.5
—
MathMath problems.
41.8 best
37.2

Benchmarks

9 shared
Only Magistral Medium: 22Only o1-mini: 10
Magistral Medium
o1-mini
9.8% best147 / 222
3.6%210 / 222
67.9% best138 / 199
60.3%156 / 199
70.8% best92 / 141
60.0%110 / 141
0.0%120 / 131
0.8% best113 / 131
5.9%117 / 126
14.0% best113 / 126
0.0%102 / 122
0.0%102 / 122
8.9%109 / 116
13.2% best106 / 116
MedQAHealthcare
89.5%51 / 95
90.2% best47 / 95
94.3% best18 / 27
90.0%22 / 27