Inference
EN
LiveBench

LiveBench Coding 2.0

Fix real bugs from merged pull requests in a large frozen codebase. Hidden tests grade the fix; a regression scores 0.

ModelsModels with a result.52
Top resultBest result on this benchmark.98.3%Claude Fable 5
Top-3 spreadPoints from first to third.2.0 pts
UpdatedDate the source changed the results.14 Oct 2026

Result and cost

52 of 52 results

Results

52 results
#ModelResultThe score from the source.CostUS dollars to run one task.
01Claude Fable 5max effort98.3%$8.93
02Claude Fable 5.1max effort97.7%$5.28
03Claude Opus 5.5max effort96.3%$5.03
04GPT-6.1 Solmax effort96.0%$0.482
05Mistral Large 4.0high effort95.4%$0.351
06Claude Sonnet 5.5max effort94.7%$4.02
07Grok 4.5xhigh effort94.3%$0.959
08GPT-6 Astramax effort93.7%$3.32
09GPT-6 Solmax effort93.1%$0.977
10Claude Haiku 5.5max effort91.4%$0.874
11GPT-6.1 Terramax effort90.8%$0.861
11Claude Opus 5max effort90.8%$3.92
13Muse Spark 1.3max effort90.2%$1.37
13DeepSeek V4.1 Flash 1017max effort90.2%$0.238
15Gemini 4 Argonhigh effort89.7%$5.08
15GPT-5.6 Solmax effort89.7%$3.77
17Grok 4.6xhigh effort89.1%$1.86
18Qwen3.8-Flash-Nextmax effort87.4%$0.106
19Qwen3.8-27Bmax effort86.8%$0.69
20Muse Wondermax effort86.2%$3.10
20GPT-5.6 Terramax effort86.2%$2.71
22Step 5 Previewmax effort85.6%$1.10
23GPT-5.5xhigh effort85.1%$4.21
24Grok 4.7xhigh effort84.5%$4.88
24GPT-6 Lunamax effort84.5%$0.095
26MiniMax M3.1 Flashmax effort83.9%$0.246
26Beam 1.0max effort83.9%$1.85
28GLM-5.3max effort82.8%$2.14
29Gemini 3.8 Flashhigh effort82.2%$2.30
30MiMo-V2.6-Prohigh effort81.5%$0.224
31GLM-5.3-Flashmax effort80.6%$0.17
32Gemini 3.7 Flashhigh effort80.5%$1.73
33Muse Spark 1.2xhigh effort78.2%$1.47
34Claude Opus 4.8max effort77.3%$4.15
35DeepSeek V4 Flash 0731max effort77.0%$0.122
36Claude Sonnet 5max effort74.7%$3.48
37GPT-5.6 Lunamax effort73.6%$1.82
37Muse Spark Openmax effort73.6%$1.25
39Smaug Nemotron 3.5 Nvfp4max effort72.2%$0.094
40MiniMax M3max effort70.9%$0.455
41Gemini 3.1 Pro Previewhigh effort66.7%$1.29
42Claude Sonnet 4.6max effort66.6%$2.63
43Nemotron Super VL-3.5max effort65.5%$0.331
44Inkling64.0%$1.88
45Nemotron Super VL-3.5 Nvfp4max effort61.3%$0.10
46Qwen3.8 Maxmax effort60.3%$1.99
47Mistral Large 4high effort60.0%$0.983
48Kimi K3max effort59.3%$2.06
49Gemma 4 31Bmax effort49.0%$0.233
50Claude Haiku 4.5max effort48.1%$0.494
51DeepSeek V4 Flash Vision Expmax effort37.6%$0.04
52Nemotron 3.5 Lightning 30B A3Bmax effort22.6%$0.085