Section outline

  • March 27th, Friday (10:30-12:30)

    Contextual word embeddings

    • BERT: next sentence prediction
    • Applications of BERT: sentiment analysis
    • Applications of BERT: named-entity recognition
    • GPT-n decoder-only model
    • Sentence-BERT

    References

    • Jurafsky and Martin, chapter 9
    • Slides from lecture