OpenAI
availableShows if the model has enough results for an index.o4-mini (high)
o4-mini (high) is a reasoning model from OpenAI in the o4-mini family. 20 benchmarks count toward its score, in 6 categories.
IndexOverall score. 50 is the middle.47.4 ±4.6
CoverageShare of the index weight with results.90%
SpeedOutput tokens per second.109/s
Input / 1MUS dollars per 1M input tokens.$1.1
Output / 1MUS dollars per 1M output tokens.$4.4
ContextMaximum tokens in one request.200K
EloLMArena rating and rank.1353 (#190)
50 is the middle of the board. The range shows the doubt in the index.
44,639 votes. Elo shows what people prefer. It does not change the score.
CapabilitiesScore per category. 50 is the middle.
50 is the middleResults
20 counted| BenchmarkThe test name. | CategoryThe capability that the test measures. | ResultThe score from the publisher. | IndexThis result on the index scale. | RunThe settings of the run. | DateDate of the result. | Published byThe source of the result. |
|---|---|---|---|---|---|---|
| MATH level 5 | Math | 97.8% | 46.8 | high effort | — | Epoch AI |
| MATH 500 | Math | 94.2% | 47.1 | — | 9 Jan 2026 | Vals AI |
| MGSM | Multilingual | 93.4% | — | — | 9 Jan 2026 | Vals AI |
| AIME | Math | 83.7% | 52.7 | — | 16 Apr 2026 | Vals AI |
| LiveCodeBench | Coding | 82.2% | 59.1 | — | 1 Sept 2026 | Vals AI |
| OTIS Mock AIME 2024-2025 | Math | 81.7% | 57.2 | high effort | — | Epoch AI |
| MMLU Pro | Knowledge | 80.6% | 47.4 | — | 1 Sept 2026 | Vals AI |
| MMMU Pro | Multimodal | 79.7% | 57.0 | — | 1 Sept 2026 | Vals AI |
| GPQA diamond | Knowledge | 79.6% | 51.7 | high effort | — | Epoch AI |
| GPQA Diamond | Knowledge | 74.5% | 47.0 | — | 1 Sept 2026 | Vals AI |
| τ²-bench Retail | Agentic | 68.3% | 47.8 | Sierra | 30 Apr 2026 | Sierra Research |
| ARC-AGI-1 (semi-private) | Reasoning | 58.7% | 54.9 | high effort | — | ARC Prize Foundation |
| SWE-bench Verified | Coding | 54.8% | 41.5 | PatchPilot-v1.1 | 1 Sept 2026 | SWE-bench team |
| τ²-bench Airline | Agentic | 52.1% | 36.2 | Sierra | 2 Mar 2026 | Sierra Research |
| τ²-bench Telecom | Agentic | 50.2% | 34.8 | Sierra | 2 Mar 2026 | Sierra Research |
| SWE-bench Verified | Coding | 45.0% | 33.6 | mini-SWE-agent | 26 Feb 2026 | SWE-bench team |
| FrontierMath-Tiers-1-3-v2-Private | Math | 36.1% | 51.8 | high effort | — | Epoch AI |
| SWE-bench Multimodal | Multimodal | 33.9% | — | GUIRepair | 17 Nov 2025 | SWE-bench team |
| SWE-bench Multimodal | Multimodal | 33.8% | — | GUIRepair | 17 Nov 2025 | SWE-bench team |
| Chess Puzzles | Reasoning | 26.0% | 57.1 | high effort | — | Epoch AI |
| FrontierMath-2025-02-28-Private | Math | 24.8% | 53.8 | high effort | — | Epoch AI |
| SimpleQA Verified | Knowledge | 18.8% | 38.9 | high effort | — | Epoch AI |
| FrontierMath-Tier-4-2025-07-01-Private | Math | 6.3% | 50.2 | high effort | — | Epoch AI |
| ARC-AGI-2 (semi-private) | Reasoning | 6.1% | 42.8 | high effort | — | ARC Prize Foundation |
| Mystery Game Puzzles | Reasoning | 5.0% | 39.2 | high effort | — | Epoch AI |
| FrontierMath-Tier-4-v2-Private | Math | 4.9% | 50.3 | high effort | — | Epoch AI |
| IOI v1 | Coding | 4.8% | 42.7 | — | 9 Aug 2026 | Vals AI |
20 benchmarks count, from 24 of 27 results. A grey row does not count. Too few models took that benchmark.