The Next Word Problem (pdf)
Next-word prediction from n-gram counts to the encoder-decoder transformer
|
The Next Word Problem (pdf)
|
1.13 M |
|
The Next Word Problem - Unit 1 (pdf)
|
365.91 K |
|
The Next Word Problem - Unit 2 (pdf)
|
467.65 K |
|
The Next Word Problem - Unit 3 (pdf)
|
454.49 K |
|
tHE Next Word Problem - Unit 4 (pdf)
|
467.11 K |
|
The Transformer Architecture (pdf)
|
2.2 M | |
|
|
14.55 M |
A language model is a conditional probability distribution over the next word given a context, and over 113 years the models have had more context, from none, to one word, to a window of words, to the whole sentence through a recurrent state, to all positions at once through attention.
The 2025 edition is course 908, Natural Language Processing, with 20 courselets.