CourseTransformers: From Attention to Trained, Served and Interpreted Models · Module 7: Architecture Families and Design Choices · part 49 of 111

Part 49 · Module 7: Architecture Families and Design Choices

Module 7: Architecture Families and Design Choices

1 min read·13 Oct 2026

What you need first

Module 6 and its lab (tinyformer-lab at v0.6.0; the lab can rebuild a stand-in)
Module 2, Lessons 4 and 5 (masks, cross-attention) and Module 4 (position kinds)
From AI Engineering Module 6: skim 02-model-families and the mixture-of-experts part of 01-architecture
No GPU, no API key; Lesson 2 and the lab read small Hugging Face Hub files

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.