| Jan 22 |
Introduction |
|
NLP (circa 2001) |
| Jan 24 |
" |
PDF |
|
| |
Text classification |
|
M&S 7.4,16.2-16.3, Collins: Naive Bayes (Sec 1-4), Collins: Log Linear (Sec 2), MaxEnt, Baselines, CNN Classification Naive Bayes prior derivation |
| Jan 29 |
No class |
|
|
| Jan 31 |
Text classification |
PDF |
|
| Feb 5 |
" |
PDF |
|
| Feb 7 |
Neural networks |
PDF |
Primer, Back-prop, Deep Averaging Networks, Gradient Checks (briefly), Gradient Checks (in details) |
| Feb 12 |
Computation graphs |
PDF |
Intro to Computation Graphs |
| Feb 14 |
Meta NLP |
PDF |
|
| |
Lexical semantics and embeddings |
|
w2v explained, word2vec, word2vec phrases, Hill2016, Turney2010 |
| Feb 19 |
PyTorch/DyNet tutorial |
|
Notebooks |
| Feb 21 |
Lexical semantics and embeddings |
PDF |
|
| Feb 26 |
No class - February break |
|
|
| Feb 28 |
" |
PDF |
|
| Mar 5 |
Language modeling |
PDF |
J&M 4, M&S 6, Collins: LM, Smoothing, Char RNN |
| Mar 7 |
" |
PDF |
|
| Mar 12 |
" |
PDF |
|
| |
Sequence modeling |
|
J&M 5.1-5.3, 6, M&S 3.1, 9, 10.1-10.3, Collins: HMM, Collins: MEMMs (Sec 3), Collins: CRF (sec 4), Collins: Forward-backward, SOTA Taggers, TnT Tagger, Stanford Tagger |
| Mar 14 |
" |
PDF |
|
| Mar 19 |
" |
PDF |
|
| Mar 21 |
" |
PDF |
|
| |
Recurrent neural networks |
|
BPTT, RNN Tutorial, Effectiveness, Luong2015 |
| Mar 26 |
" |
PDF |
|
| Mar 28 |
" |
PDF |
|
| Apr 2 |
No class - Spring break |
|
|
| Apr 4 |
No class - Spring break |
|
|
| Apr 9 |
No class - Campus event |
|
|
| Apr 11 |
Dependency parsing |
PDF |
J&M 12.7, Nivre2003, Chen2014 |
| Apr 16 |
" |
PDF |
|
| Apr 18 |
" |
PDF |
|
| |
Constituency parsing |
|
J&M 12.1-12.6, 13.1-13.4, 14.1-14.4, M&S 11, 12.1, Collins: PCFGs, Eisner: Inside-outside, Collins: Inside-outside |
| Apr 23 |
" |
PDF |
|
| Apr 25 |
" |
PDF |
|
| May 30 |
" |
PDF |
|
| May 2 |
IBM translation models |
PDF |
J&M 25.5, M&S 13.1-13.2, Collins: IBM Models, IBM Models, Collins: EM (Sec 5-6), HMM alignments, IBM Model 2 EM Notebook |
| May 7 |
" |
PDF |
|
| |
Contextualized word representations |
|
Annotated Transformer, Illustrated Transformer, ELMo, BERT, The Illustrated BERT, ELMo, and co. |