Welcome to
Fundamentals of transformers - Live Workshop
Course Syllabus and Content
Module 1
What are LLMs?
2 Lessons
Demystifying terminology behind LLMs
- Sneak Peek
- Sneak Peek
Module 2
What LLMs predict
2 Lessons
Introduction to Autoregressive Decoding
- Sneak Peek
- Sneak Peek
Module 3
How LLMs predict
3 Lessons
The architecture for a Large Language Model
- Sneak Peek
- Sneak Peek
- Sneak Peek
Module 4
How Transformers predict
3 Lessons
The innards of a transformer layer
- Sneak Peek
- Sneak Peek
- Sneak Peek
Module 5
How LLMs attend
4 Lessons
How to find the needle in the haystack
- Sneak Peek
- Sneak Peek
- Sneak Peek
- Sneak Peek
Module 6
Modern LLM connection to papers
3 Lessons
Connection to papers
- Sneak Peek
- Sneak Peek
- Sneak Peek