Deep Learning for Natural Language Processing: A Gentle Introduction

Latest draft: January 21, 2022

CHANGES:

• 01/21/2022: Fixed several typos in Chapters 4 and 12. Started the CRF section.
• 01/14/2022: Added Chapter 4 (implementing LR from scratch and in PyTorch) and content to Chapter 12 on RNNs and LSTMs.
• 10/22/2021: Added Chapter 10 on transformer networks
• 07/06/2021: Completed Chapter 6 (best practices); added Appendix B (character encodings)
• 04/16/2021: Added Chapter 6.3: Activation Functions
• 04/13/2021: Added discussion of mini-batching in Chapter 6
• 03/25/2021: Fixed several typos in Chapter 5
• 03/19/2021: Added first draft of Chapter 5: Feed Forward Neural Networks
• 02/17/2021: Improved discussion in Section 3.7
• 02/05/2021: Added Section 3.6: Evaluation Measures for Multiclass Text Classification
• 01/27/2021: Added Chapter 7: Distributional Hypothesis and Representation Learning

(Some) SLIDES:

• Chapter 5
• Chapter 6
• Chapter 8
• Chapter 10

You are welcome to use the slides any way you wish. But I would appreciate providing credit. And, optionally, dropping me a note if you found them useful.

CODE: https://github.com/clulab/gentlenlp