Grade School Math 8K

GSM8K tests multi-step arithmetic in grade-school word problems. OpenAI introduced the dataset in 2021; a high score on this fixed test is one piece of evidence about mathematical reasoning.

ModelsModels with a result.7
Top resultBest result on this benchmark.—
Top-3 spreadPoints from first to third.—
YearYear of release.2021

Results

7 results
#ModelResultThe score from the source.
—Celeris-193.7%
—Phi-3.5-mini86.2%
—Llama 3.1 8B84.5%