The Unreasonable Effectiveness of Data

Editorial record

Plain-language summary

Drawing on web-scale examples, the authors contend that unreasonably large corpora let comparatively simple methods succeed where elaborate ones with little data fail, and urge researchers to embrace data. Written years before deep learning’s dominance, it foreshadowed the data-centric logic later formalized by scaling laws. It is a conceptual ancestor of the scaling era.