Jacob Devlin
(3 articles)
2018
BERT
Bidirectional Encoder Representations from Transformers
Bidirectional Encoder Representations from Transformers
Deep Learning model for NLP that significantly improves the understanding of context and the meaning of words in sentences by analyzing text bidirectionally.
Generality: 786
2018
MLM
Masked-Language Modeling
Masked-Language Modeling
Training technique where random words in a sentence are replaced with a special token, and the model learns to predict these masked words based on their context.
Generality: 735
2018
DLMs
Deep Language Models
Deep Language Models
Advanced ML models designed to understand, generate, and translate human language by leveraging DL techniques.
Generality: 874