Scaling Laws & Compute · 2019
The Bitter Lesson
Argued from 70 years of AI history that general methods leveraging more computation reliably beat approaches built on human-designed knowledge, a lesson repeatedly relearned and central to the scaling era.
Editorial record
Plain-language summary
Sutton observes that in game-playing, speech, and vision, hand-crafted domain knowledge gave early wins but was eventually overtaken by search and learning methods that scale with compute. The uncomfortable conclusion is that human insight matters less than the ability to exploit growing computation. The essay became a rallying text for scaling-first research.
Knowledge graph
Relationships
Antecedents
Conceptual ancestorEvidence: Strongly supported
Scaling Laws for Neural Language Models
The bitter lesson anticipated compute-driven scaling over hand-design
book
Source record
Provenance
- Record ID
- P-510
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.