computational language understanding lab


Deep Learning for Natural Language Processing: A Gentle Introduction

Latest draft: January 21, 2022

CHANGES:

  • 01/21/2022: Fixed several typos in Chapters 4 and 12. Started the CRF section.
  • 01/14/2022: Added Chapter 4 (implementing LR from scratch and in PyTorch) and content to Chapter 12 on RNNs and LSTMs.
  • 10/22/2021: Added Chapter 10 on transformer networks
  • 07/06/2021: Completed Chapter 6 (best practices); added Appendix B (character encodings)
  • 04/16/2021: Added Chapter 6.3: Activation Functions
  • 04/13/2021: Added discussion of mini-batching in Chapter 6
  • 03/25/2021: Fixed several typos in Chapter 5
  • 03/19/2021: Added first draft of Chapter 5: Feed Forward Neural Networks
  • 02/17/2021: Improved discussion in Section 3.7
  • 02/05/2021: Added Section 3.6: Evaluation Measures for Multiclass Text Classification
  • 01/27/2021: Added Chapter 7: Distributional Hypothesis and Representation Learning

(Some) SLIDES:

You are welcome to use the slides any way you wish. But I would appreciate providing credit. And, optionally, dropping me a note if you found them useful.

CODE: https://github.com/clulab/gentlenlp