by Facebook AI · Natural Language Processing
Robustly optimized BERT algorithm that improves upon BERT with new pretraining objectives, larger mini-batches, and higher learning rates for better NLP performance.
No problems reported for this model.