Historical milestone · 2017
Attention Is All You Need
Reviewed through September 18, 2026
2017 · Historical milestone
Attention Is All You Need
- Era
- 2010s
- Theme
- Language models & representation
- Evidence form
- Architecture + translation benchmarks
- School / paradigm
- Attention / sequence modeling
- Institution / context
- Google Brain; Google Research; University of Toronto
- Researchers
- Ashish Vaswani; collaborators
Understand
Plain-language record, transferred from the reviewed source module.
Theory or experimental setup. Replaced recurrence with stacked self-attention and feed-forward blocks in an encoder-decoder translation model.
Result / historical claim. Enabled parallel sequence training and direct token-to-token interactions while improving tested translation benchmarks.
Apply
Professional implication, only where the reviewed record states one.
The checked-in record does not state a separate professional application for this entry. The topic page places it in the wider research lineage: .
Verify
Evidence status, stated limitations, and the external sources this record actually carries.
Evidence form. Architecture + translation benchmarks
Limitation / debate. Standard attention has quadratic sequence cost and does not solve grounding, factuality, or data bias.
Source status. This milestone row does not carry a primary-source URL in the approved export, and we do not have a verified link for it in our own research. We do not guess one.
No primary-source URL is recorded for this entry in our reviewed data. Rather than manufacture a citation, we link the Implement Agentic research page that carries the record.
Reproduce
A reproduction tutorial is linked only when one exists for this exact record.
A reproduction tutorial is not yet available for this entry. The closest reviewed material is .
Cite or share
APA-like: This historical record carries a year only, and no author or publisher of record in the checked-in data. An APA reference would have to invent that metadata.
BibTeX: BibTeX requires an author and publication venue. Historical lineage entries store a narrative record and its source link, not structured authorship, so the field would be fabricated.