CourseRetrieval-Augmented Generation: The Complete Course · Module 12: Production Engineering · part 86 of 95
Part 86 · Module 12: Production Engineering

Lesson 5: Seeing every request, and failing honestly

28 min read·13 Oct 2026
Module 12 · Lesson 5 · About 60 minutes · Needs: Module 1 Lesson 2 (the stage trace), Module 5 Lesson 3 (permission filters), Module 9 Lesson 1 (the answer contract) and Module 11 Lesson 5 (regression cases)

The situation

Friday 9 October 2026. Farah forwards a finding: the answer the staging service gave to Ellie's replayed chat this morning mentioned an agent's note from her own case file, a staff-only ticket. Nobody can say which documents reached the prompt, or since when. Grace adds a second worry: what does Ellie see on the day the model provider is down?

This lesson gives every request one ID, logs what was retrieved, alerts when quality drops, replays the failure, and plans for broken parts. The incident, traffic and outages are simulated.

The rest of this course is yours to keep

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.