NLP - Ethics and Future Directions

  • 0 Rating
  • 0 Reviews
  • 2 Students Enrolled

NLP - Ethics and Future Directions

Bias measurement and fairness techniques, privacy, environmental cost and open questions on the future of NLP

  • 0 Rating
  • 0 Reviews
  • 2 Students Enrolled
  • Wishlist
  • Free
  • Course Includes
  • PDF slides, 19 pages
  • LaTeX source and figures (zip)
  • Quiz, 4 questions
Tags:
AI Ethics Bias Fairness Privacy NLP



What you will learn

  • Detect bias in a language model with template-based tests, the Word Embedding Association Test and counterfactual evalua...
  • Distinguish pre-processing, in-processing and post-processing approaches to fairness
  • Name privacy techniques such as differential privacy and federated learning and weigh the carbon cost of accuracy gains

Courselet Content

2 components
NLP - Ethics and Future Directions (pdf)
420.29 K

Requirements

  • Pre-trained language models such as BERT and GPT

General Overview

Description

Bias in language models has sources such as historical bias in the training data, and it is measured by template-based tests, the Word Embedding Association Test and counterfactual evaluation. In a template test, male and female completions of The [MASK] is a doctor are compared, and in counterfactual evaluation demographic attributes in a text are swapped and the change in predictions is measured. Fairness interventions are applied to the data (pre-processing), the training objective (in-processing) or the outputs (post-processing), followed by continuous monitoring. Privacy risks are addressed by differential privacy training and federated learning. The carbon cost of large models is weighed against accuracy gains, and future directions include multilingual models and open questions about alignment and artificial general intelligence.

Courses that include this CL

blog
Last Updated 19th November 2026
  • 5
  • Free

Recommended for you

blog
Last Updated 10th December 2023
  • 5
blog
Last Updated 2nd August 2023
  • 2
  • Free
blog
Last Updated 16th June 2023
  • 7
blog
Last Updated 8th May 2023
  • 27
blog
Last Updated 17th December 2022
  • 30
blog
Last Updated 7th January 2023
  • 22
  • Free
blog
Last Updated 7th January 2023
  • 8
  • Free
blog
Last Updated 14th March 2025
  • 52
  • Free
blog
Last Updated 19th November 2023
  • 7
blog
Last Updated 20th August 2025
  • 50
  • Free
blog
Last Updated 13th December 2022
  • 141
  • Free
blog
Last Updated 7th November 2022
  • 16
  • Free
blog
Last Updated 21st March 2025
  • 251
  • Free

Meet the instructors !

instructor
About the Instructor

https://www.joergosterrieder.com/