CourseTransformers: From Attention to Trained, Served and Interpreted Models · Module 4: Positional Information · part 27 of 111

Part 27 · Module 4: Positional Information

Module 4: Positional Information

1 min read·13 Oct 2026

What you need first

Module 3 and its lab (tinyformer-lab at v0.3.0; this module's lab rebuilds a stand-in if needed)
Module 2, Lessons 4 and 5 (masks, grouped-query attention)
From AI Engineering Module 6: skim each lesson's first section
No GPU, no API key

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.