Scaling Laws & Compute · 2019

The Bitter Lesson

Richard Sutton

Argued from 70 years of AI history that general methods leveraging more computation reliably beat approaches built on human-designed knowledge, a lesson repeatedly relearned and central to the scaling era.

Editorial record

Plain-language summary

Sutton observes that in game-playing, speech, and vision, hand-crafted domain knowledge gave early wins but was eventually overtaken by search and learning methods that scale with compute. The uncomfortable conclusion is that human insight matters less than the ability to exploit growing computation. The essay became a rallying text for scaling-first research.

Knowledge graph

Relationships

Antecedents

Source record

Provenance

Record ID
P-510
Record created
2026-07-13
Last reviewed
2026-07-14
Record version
2

Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.