Date Lecture Readings Logistics
Module 1: Introduction to Natural Language Processing
1/21 Lecture #1 :
Introduction to NLP
[ slides | video ]

1/26 Lecture #2 :
Deep Learning Basics
[ slides | video ]

1/28 Lecture #3 :
Text Classification
[ slides | video ]

1/30 Lecture #4 :
Word Representations
[ slides | video ]

2/2 Lecture #5 :
Language Models
[ slides | video ]

2/4 Lecture #6 :
Recurrent Networks
[ slides | video ]

2/6 Lecture #7 :
Attention and Transformer I
[ slides | video ]

2/9 Lecture #8 :
Attention and Transformer II
[ slides | video ]

HW 1 due & Teaming Spreadsheet due (11:59pm 2/6)
2/11 Lecture #9 :
Sequence to Sequence Generation
[ slides | video ]

2/13 Lecture #10 :
Course project introduction
[ slides | video ]

2/16 Lecture #11 :
Tokenization
[ slides | video ]

2/18 Lecture #12 :
Sequence Labeling I
[ slides ]

2/20 Lecture #13 :
Sequence Labeling II
[ slides ]

2/23 Lecture #14 :
Syntatic Parsing I
[ slides ]

Module 2: Large Language Models
2/25 Lecture #15 :
Pre-training LLMs
[ slides ]

HW 2 due (11:59pm 2/25)
2/27 Lecture #16 :
Instruction Tuning and Multitask Learning
[ slides ]

3/2 Lecture #17 :
Parameter-efficient Fine-tuning
[ slides ]

3/4 Lecture #18 :
Prompting and Zero-/Few-shot Learning
[ slides ]

3/6 Project Proposal Discussion
3/9 Lecture #19 :
Alignment: RL Basic
[ slides ]

HW 3 due (11:59pm 3/9)
3/11 Lecture #20 :
Alignment: RLHF, DPO
[ slides ]

Module 3: Scaling up LLMs
3/13 Lecture #21 :
Long-Context Language Models
[ slides ]

3/16 Lecture #22 :
Inference: KV Cache Optimization
[ slides ]

3/18 Lecture #23 :
Mixture of Experts in LLMs
[ slides ]

3/20 Lecture #24 :
Retrieval-Augmented Generation of LLMs I
[ slides ]

3/23 Lecture #25 :
Retrieval-Augmented Generation of LLMs II
[ slides ]

Module 4: Expanding LLMs beyond One Language
3/25 Lecture #26 :
Multilingual LLMs: Languages and Cultures I
[ slides ]

3/27 Lecture #27 :
Multilingual LLMs: Machine Translation II
[ slides ]

HW 4 due (11:59pm 3/27)
4/6 Lecture #28 :
Latent Variable Models
[ slides ]

4/8 Lecture #29 :
Multimodal Learning: Vision and Language I
[ slides ]

4/10 Project Progress Discussion
4/13 Lecture #30 :
Multimodal Learning: Vision and Language II
[ slides ]

4/15 Lecture #31 :
Multimodal Learning: Speech and Language I
[ slides ]
  • TBD

4/17 Lecture #32 :
Multimodal Learning: Speech and Language II
[ slides ]
  • TBD

4/20 Lecture #33 :
LLMs and Knowledge-Graph
[ slides ]

Module 5: Advanced Topics of NLP
4/22 Lecture #34 :
LLM Reasoning and Verification I
[ slides ]

4/24 Lecture #35 :
LLM Reasoning and Verification II
[ slides ]

4/27 Lecture #36 :
Language Agents: Basic and Tool Use
[ slides ]

4/29 Lecture #37 :
Language Agents: Software Development and Web Browsing
[ slides ]

5/1 Lecture #38 :
Social and Broader Impacts of NLP
[ slides ]

5/4 Project Presentation
5/6 Project Presentation
5/8 Project Presentation
5/8 Hw 5: Project Report due 11:59pm 5/8