Section outline

  • March 26th, Wednesday (16:30-18:30)

    Large language models

    • Pretraining
    • Training corpora
    • Scaling laws for LLMs
    • Overview of LLMs
    • Multi-lingual LLMs

    Exercises

    • Positive pointwise mutual information (PPMI)

    References

    • Jurafsky and Martin, chapter 10
    • Slides from lecture