Language Models are Few-Shot Learners
OpenAI · · Research
OpenAI trained GPT-3, a 175B-parameter autoregressive language model that demonstrated in-context few-shot learning without fine-tuning — sometimes becoming competitive with prior state-of-the-art fine-tuning approaches.
Why it matters
Proved that massive scale enables a qualitatively different capability: few-shot learning. Marked the transition from research curiosity to commercial viability. The foundation-model paradigm starts here.
This is LLM World's historical reading, not a claim by OpenAI. The facts above and the sources below are what it rests on.
Model line behind it: GPT.
Sources
Record status: verified · confidence 95/100
arXiv paper 2005.14165, submitted 2020-05-28. The paper is the primary source. The API launched 2020-06-11.