Attention Is All You Need
Google Brain · · Research
Google Brain published the Transformer architecture, replacing recurrent neural networks with self-attention mechanisms. The paper demonstrated that attention alone, without recurrence or convolutions, could achieve state-of-the-art results on machine translation.
Why it matters
Every large language model since — GPT, BERT, PaLM, Gemini, Llama — is a Transformer. The architecture is the foundation of the entire field. Without it, there is no modern AI.
This is LLM World's historical reading, not a claim by Google Brain. The facts above and the sources below are what it rests on.
Sources
Record status: verified · confidence 95/100
arXiv paper 1706.03762, submitted 2017-06-12. The paper is the primary source; the date is the arXiv submission timestamp.