Section outline

  • March 13th, Wednesday (10:30-12:30)

    Words and meaning

    • Semantic properties of neural word embeddings
    • Evaluation
    • Cross-lingual word embeddings
    • Research papers

    Language models

    • Language modeling: prediction and generation
    • Language modeling applications
    • Relative frequency estimation
    • N-gram model
    • N-gram probabilities and bias-variance trade-off
    • Practical issues
    • Evaluation: perplexity measure
    • Sampling sentences
    • Smoothing: Laplace and add-k smoothing
    • Stupid backoff and linear interpolation

    References

    • Jurafsky and Martin, chapter 6
    • Jurafsky and Martin, chapter 3

    Resources