Section outline

  • March 22nd, Friday (10:30-12:30)

    Large language models

    • BERT: masked language modeling and next sentence prediction
    • Other models
    • The GPT-n family of large language models
    • Other large language models
    • Multi-lingual large language models

    References

    • Jurafsky and Martin, chapter 11
    • Voita, NLP Course | For You (web course): Transfer Learning
    • Slides from lecture