Pretrained models have enabled so much in CV, excited to see similar shifts in the language world.

A great supplement is Sebastian’s NLP progress repo: https://github.com/sebastianruder/NLP-progress