Primer
Learn how language models work, one idea at a time. Read an explanation, try an activity, and check what you’ve learned.
Started by Evan Borodow and co-developed with Calvin Shu, now part of Access AI Education. The course is free, and you can start without any coding experience.
Choose how you want to learn
Start with Explorer if this is new to you. You can change the level in any lesson, or revisit a topic whenever you like.
Start with predictionPrediction
How a language model chooses what comes next.
Tokens
How text becomes pieces a model can work with.
Learning
How predictions improve through practice and feedback.
Embeddings
How numbers represent relationships between words.
Attention
How a model uses the surrounding words for context.
The full picture
Follow the steps through a transformer.
Final review
Check your understanding and find out what to revisit.