Natural Language Processing

  • 5 Rating
  • 1 Reviews
  • 5 Students Enrolled

Natural Language Processing

Twenty courselets from n-gram models to transformers, decoding, fine-tuning and ethics, with notebooks and quizzes

  • 5 Rating
  • 1 Reviews
  • 5 Students Enrolled
  • Free
  • Course Includes
  • 20 courselets in order
  • Slides as PDF in 17 courselets
  • Jupyter notebooks in 3 courselets
  • Quizzes in 17 topics, 70 questions
Tags:
Language Models Transformers Deep Learning Machine Learning NLP



What you will learn

  • Trace next-word prediction from n-gram counts through recurrent networks and attention to pre-trained transformers
  • Implement attention, subword tokenization and decoding strategies in Python
  • Assess language models for efficiency, bias and privacy

Course Content

19 courselets
Natural Language Processing - Introduction (pdf)
2 M
Foundations and Statistical Language Models (pdf)
376.83 K
Neural Networks - Introduction (pdf)
1.23 M
NLP - Neural Language Models (pdf)
301.68 K
NLP - Recurrent Neural Networks (pdf)
309.36 K
NLP - Sequence-to-Sequence Models (pdf)
431.84 K
NLP - The Transformer Revolution (pdf)
395.77 K
The Transformer Architecture (pdf)
2.2 M
14.55 M
NLP - Pre-trained Language Models (pdf)
361.71 K
NLP - Advanced Transformers (pdf)
455.89 K
NLP - Tokenization and Subword Models (pdf)
335.17 K
NLP - Decoding Strategies (pdf)
466.13 K
NLP Decoding Strategies (pdf)
2.45 M
NLP Decoding Strategies (pdf)
1.25 M
NLP - Fine-tuning and Prompt Engineering (pdf)
419.83 K
NLP - Efficiency and Deployment (pdf)
517.48 K
NLP - Ethics and Future Directions (pdf)
420.29 K
NLP - Predicting the next word (pdf)
703.25 K

Requirements

  • Probability and statistics, Python

General Overview

Description

Next-word prediction is the training task of every language model in the course, from bigram counts to transformers. Topics are n-gram models and smoothing, word embeddings, recurrent networks, sequence-to-sequence models, attention, pre-training with BERT and GPT, tokenization, decoding, fine-tuning, efficiency and ethics, with notebooks in Python for several of them. The 2026 edition of the next-word material is course 100100, The Next Word Problem - Full Course. The courselets in order:

  1. NLP - Introduction
  2. NLP - Foundations and Statistical Language Models
  3. Neural Networks - Introduction
  4. NLP - Neural Language Models
  5. NLP - Recurrent Neural Networks
  6. NLP - Sequence-to-Sequence Models
  7. NLP - The Transformer Revolution
  8. NLP - The Transformer Revolution, Notebook
  9. The Transformer Architecture
  10. NLP - Pre-trained Language Models
  11. NLP - Advanced Transformers
  12. NLP - Tokenization and Subword Models
  13. NLP - Decoding Strategies
  14. NLP - Decoding Strategies, From Probabilities to Text
  15. NLP - Decoding Strategies Lab
  16. NLP - Fine-tuning and Prompt Engineering
  17. NLP - Efficiency and Deployment
  18. NLP - Ethics and Future Directions
  19. NLP - Predicting the Next Word
  20. NLP - Notebooks

Recommended for you

blog
Last Updated 8th March 2025
  • 1
blog
Last Updated 10th December 2023
  • 5
blog
Last Updated 19th July 2023
  • 0
  • 0
blog
Last Updated 16th June 2023
  • 7
blog
Last Updated 16th January 2023
  • 47
  • Free
blog
Last Updated 7th January 2023
  • 22
  • Free
blog
Last Updated 16th January 2023
  • 49
  • Free
blog
Last Updated 7th January 2023
  • 8
  • Free
blog
Last Updated 14th March 2025
  • 52
  • Free
blog
Last Updated 24th September 2026
  • 5
blog
Last Updated 19th November 2023
  • 7
blog
Last Updated 13th December 2022
  • 141
  • Free
blog
Last Updated 7th November 2022
  • 16
  • Free
blog
Last Updated 21st March 2025
  • 251
  • Free

Meet the instructors !

instructor
About the Instructor

https://www.joergosterrieder.com/

Student's feedback

5
Course Rating
100% `  
100%  
100%