CourseLarge Language Models: The Complete Course · Module 3: Inference and Decoding · part 21 of 103
Part 21 · Module 3: Inference and Decoding

Module 3: Inference and Decoding

1 min read·13 Oct 2026

What you need first

  • Module 1: the setup cell, the shared data, TinyLM and the supportdesk/ package (its lab, or the cells in this module's lab)
  • Module 2, Lessons 1 and 4: tokens, and what a ticket costs
  • Basic PyTorch helps: the lessons open SmolLM2-135M-Instruct locally to show its scores

The rest of this course is yours to keep

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.