Scaling Laws & Compute · 2022
Emergent Abilities of Large Language Models
This paper documents that certain capabilities are absent in smaller language models yet appear once scale crosses a threshold, arguing such abilities are not predictable by extrapolating small-model performance and framing scale itself as unlocking qualitatively new behavior.
Editorial record
Plain-language summary
The authors survey tasks where accuracy stays near chance for small models and then rises sharply beyond a certain parameter or compute scale, calling these emergent abilities. They catalog examples across few-shot prompting and augmented-prompting settings, showing the jumps are not evident from the performance trend of smaller models. The claim shaped how the field reasoned about scaling, suggesting some capabilities cannot be forecast and appear only after crossing a size threshold.
Knowledge graph
Relationships
Antecedents
ChallengesEvidence: Direct
Are Emergent Abilities of LLMs a Mirage?
Mirage shows emergence is partly a metric artifact
P-103 abstract
Source record
Provenance
- Record ID
- P-102
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
- https://arxiv.org/abs/2206.07682
- arXiv:2206.07682
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.