Welcome to
Fundamentals of transformers - Live Workshop
Course Syllabus and Content
Module 1
What are LLMs?
2 Lessons 11 Minutes
Demystifying terminology behind LLMs
Introduction
Introduction to the LLMs
Module 2
What LLMs predict
3 Lessons 20 Minutes
Introduction to Autoregressive Decoding
Module 3
How LLMs predict
3 Lessons 19 Minutes
The architecture for a Large Language Model
Module 4
How Transformers predict
4 Lessons 40 Minutes
The innards of a transformer layer
Module 5
How LLMs use position
5 Lessons 39 Minutes
How to Leverage Positional Bias
Module 6
How LLMs attend
1 Lesson 7 Minutes
How to find the needle in the haystack
Module 7
Modern LLM connection to papers
2 Lessons 23 Minutes
Connection to papers