- SOTA in 2020: XLNet; similar: RoBERTa, DeBERTa, T5 - Most efficient: DynaBERT (past: DistillBERT) - Large documents: BigBird, also: Longformer, Reformer - Multilingual: mBERT, XLM-Roberta - Past: ULMFiT, BERT ## Leaderboards - Text Classification - [NLP Progress](http://nlpprogress.com/english/text_classification.html) - [Papers With Code](https://paperswithcode.com/task/text-classification) - Sentiment Analysis - [NLP Progress](http://nlpprogress.com/english/sentiment_analysis.html) - [Papers With Code](https://paperswithcode.com/task/sentiment-analysis)