GPT-3 and emergent in-context learning (2020)
OpenAI's GPT-3 language model, trained on standard next-token prediction, began completing tasks from examples placed in its prompt—no weight updates, no fine-tuning. Few-shot and one-shot learning emerged as artifacts of scale that nobody had engineered directly.
Researchers and developers adopted prompt engineering as a new adaptation method, radically lowering the cost of using language models for new tasks.
In-context learning became a defining property of large language models and a template for scaling laws across AI domains.
GEN-1.5's physical prompting mirrors the GPT-3 pattern: a capability the company says emerged from pretraining, not from explicit meta-learning objectives. It is the first physical analog at scale.
