How AI Actually Works: From Neurons to ChatGPT
Unit 2 · Lesson 1

From Sentence to Training Examples: Tokens and the Hidden Answer Key

You can split a sentence into tokens, slide through it to build next-token training examples, and say exactly how many examples a 12-token sentence gives with no human labeller.
Next: One Token at a Time: The Probability List and the Loop →
0:00 / 15:57
Chapter 1 of 5 — The Whole Machine, and Its Missing Piece
Like it? Keep going.

A free account saves your progress in the free library. A paid plan puts a tutor right here: pause and ask about anything on screen. It adds flashcards and practice tests, and lessons built or rebuilt for the way you learn.

Sign up free