Section outline

  • March 17th, Monday (16:30-18:30)

    Neural language models (NLM)

    • General architecture for NLM
    • Feedforward NLM: inference
    • Feedforward NLM: training
    • Recurrent NLM: inference
    • Recurrent NLM: training
    • Practical issues: parameter freezing, weight tying, softmax temperature

    References

    • Voita, NLP Course | For You (web course): Language Modeling
    • Jurafsky and Martin, sections 7.6, 7.7
    • Jurafsky and Martin, section 8.2

    Resources