Welcome to

Fundamentals of transformers - Live Workshop

Course Syllabus and Content

Module 1

What are LLMs?

2 Lessons

Demystifying terminology behind LLMs

Module 2

What LLMs predict

2 Lessons

Introduction to Autoregressive Decoding

Module 3

How LLMs predict

3 Lessons

The architecture for a Large Language Model

Module 4

How Transformers predict

3 Lessons

The innards of a transformer layer

Module 5

How LLMs attend

4 Lessons

How to find the needle in the haystack

Module 6

Modern LLM connection to papers

3 Lessons

Connection to papers