GSM8K / MATH (mathematical reasoning)

Editorial record

Plain-language summary

MATH contains 12,500 competition-level problems, each with a worked solution, spanning subjects like algebra, geometry, and number theory at varying difficulty. Because answers require multi-step derivations rather than lookup, early large models scored very low, making it a clear measure of reasoning progress. It is often paired with GSM8K, a grade-school word-problem set, and together they became standard yardsticks for tracking improvements in chain-of-thought and mathematical reasoning.