Kristina Toutanova
(2 articles)
2018
BERT
Bidirectional Encoder Representations from Transformers
Bidirectional Encoder Representations from Transformers
Deep Learning model for NLP that significantly improves the understanding of context and the meaning of words in sentences by analyzing text bidirectionally.
Generality: 786
2018
MLM
Masked-Language Modeling
Masked-Language Modeling
Training technique where random words in a sentence are replaced with a special token, and the model learns to predict these masked words based on their context.
Generality: 735