Emergent abilities are capabilities absent in small and mid-size models that appear seemingly suddenly above a certain scale. Wei et al.'s 2022 paper documented this behavior across many tasks and helped popularize the term. Some later research argued the effect is partly an artifact of metric choice — it remains an open debate. In practice the appearance of capabilities like Reasoning and complex instruction following is one of the main arguments behind continued investment in Scaling Laws.
MEVZU N°124ISTANBULYEAR I — VOL. III
Glossary · Intermediate · 2022
Emergent Abilities
Capabilities that appear in models only above a certain scale and are absent in smaller variants.
- EN — English term
- Emergent Abilities
- TR — Turkish term
- Ortaya Çıkan Yetenekler