Next Words - Lesson 14 - In-Context Learning, Prompting

  • 0 Rating
  • 0 Reviews
  • 1 Students Enrolled

Next Words - Lesson 14 - In-Context Learning, Prompting

Frozen weights, demonstrations, prompt design, written steps, majority votes, prompt cost

  • 0 Rating
  • 0 Reviews
  • 1 Students Enrolled
  • Free
  • Course Includes
  • PDF lecture, 21 pages
  • Jupyter notebooks, 4 (zip)
  • Quiz, 5 questions
Tags:
prompting in-context learning chain of thought self-consistency tool use



What you will learn

  • Compute the posterior over tasks after n demonstrations from the odds each one multiplies.
  • Select demonstrations by cosine similarity and compute the range of scores over random draws.
  • Compute the accuracy of a majority vote over independent chains and the daily bill of a prompt.

Courselet Content

2 components
Next Words - Lesson 14 - In-Context Learning, Prompting (pdf)
298.77 K

Requirements

  • Probability, cosine similarity, Python

General Overview

Description

Over five random draws of demonstrations, the SST-2 accuracy of GPT-3 is between 86.9 and 95.8 per cent, a range of 8.9 points. In the posterior over tasks the odds are multiplied by 3 with each consistent demonstration, and after one trailing space the top next token of GPT-2 is "urn" where it was "floor". Exact match on NQ is 28.6 with random demonstrations and 41.6 with demonstrations chosen by cosine similarity. LaMDA 137B is right on 14.3 per cent of GSM8K problems with the working before the answer and on 6.1 after it. Accuracy of PaLM 540B grows from 56.5 to 74.4 per cent under a majority vote over 40 chains. The daily bill is $1,000 at 100 tokens against $20,000 at 2,000. Students work through four notebooks, one on in-context learning and three workbooks.

Courses that include this CL

blog
Last Updated 19th November 2026
  • 1
  • Free

Recommended for you

blog
Last Updated 3rd December 2024
  • 5
  • Free
blog
Last Updated 19th July 2023
  • 0
  • 0
blog
Last Updated 16th June 2023
  • 7
blog
Last Updated 8th May 2023
  • 27
blog
Last Updated 17th December 2022
  • 30
blog
Last Updated 16th January 2023
  • 49
  • Free
blog
Last Updated 7th January 2023
  • 8
  • Free
blog
Last Updated 14th March 2025
  • 52
  • Free
blog
Last Updated 20th August 2025
  • 50
  • Free
blog
Last Updated 7th November 2022
  • 16
  • Free
blog
Last Updated 21st March 2025
  • 251
  • Free

Meet the instructors !

instructor
About the Instructor

https://www.joergosterrieder.com/