Historical milestone · 2019
BERT
Reviewed through September 18, 2026
2019 · Historical milestone
BERT
- Era
- 2010s
- Theme
- Language models & representation
- Evidence form
- Pretraining + downstream benchmarks
- School / paradigm
- Bidirectional representation learning
- Institution / context
- Google AI Language
- Researchers
- Jacob Devlin; Ming-Wei Chang; Kenton Lee; Kristina Toutanova
Understand
Plain-language record, transferred from the reviewed source module.
Theory or experimental setup. Pretrained bidirectional transformer representations with masked-token and sentence objectives, then fine-tuned them across language tasks.
Result / historical claim. Consolidated transfer learning as the dominant pattern for language understanding benchmarks.
Apply
Professional implication, only where the reviewed record states one.
The checked-in record does not state a separate professional application for this entry. The topic page places it in the wider research lineage: Language models and representation.
Verify
Evidence status, stated limitations, and the external sources this record actually carries.
Evidence form. Pretraining + downstream benchmarks
Limitation / debate. The masking objective differs from downstream generation, and context, data bias, and task validity remained bounded.
Source status. The source link below is the verified link our reviewed topic research already carries for this milestone.
Reproduce
A reproduction tutorial is linked only when one exists for this exact record.
A reproduction tutorial is not yet available for this entry. The closest reviewed material is Language models and representation.
Cite or share
APA-like: This historical record carries a year only, and no author or publisher of record in the checked-in data. An APA reference would have to invent that metadata.
BibTeX: BibTeX requires an author and publication venue. Historical lineage entries store a narrative record and its source link, not structured authorship, so the field would be fabricated.