Section outline

  • March 31st, Monday (16:30-18:30)

    Post-training

    • Fine-tuning
    • Instruction tuning
    • Model Alignment
    • Parameter efficient fine-tuning: adapters
    • Parameter efficient fine-tuning: LoRA
    • Transfer learning

    References

    • Jurafsky and Martin, sections 11.4, 12.2, 12.3
    • Voita, NLP Course | For You (web course): Transfer Learning
    • Slides from lecture