Scaling Laws & Compute · 2022

Emergent Abilities of Large Language Models

Jason Wei, Yi Tay, Rishi Bommasani, et al.

This paper documents that certain capabilities are absent in smaller language models yet appear once scale crosses a threshold, arguing such abilities are not predictable by extrapolating small-model performance and framing scale itself as unlocking qualitatively new behavior.

Editorial record

Plain-language summary

The authors survey tasks where accuracy stays near chance for small models and then rises sharply beyond a certain parameter or compute scale, calling these emergent abilities. They catalog examples across few-shot prompting and augmented-prompting settings, showing the jumps are not evident from the performance trend of smaller models. The claim shaped how the field reasoned about scaling, suggesting some capabilities cannot be forecast and appear only after crossing a size threshold.

Knowledge graph

Relationships

Antecedents

Source record

Provenance

Record ID
P-102
Record created
2026-07-13
Last reviewed
2026-07-14
Record version
2

Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.