CourseRetrieval-Augmented Generation: The Complete Course · Module 11: Evaluation · part 75 of 95
Part 75 · Module 11: Evaluation

Lesson 2: Scoring the answer, not only the search

27 min read·13 Oct 2026
Module 11 · Lesson 2 · About 50 minutes · Needs: Module 9 Lessons 1 to 3 (the answer contract, citations, NLI checks); Lesson 1 of this module helps but is not required

The situation

On Friday 9 October 2026 Ellie Shaw asks whether her repeated E7 fault is covered. Lesson 1 measures whether the right documents came back. Grace asks something else: "Was the answer any good? And when the documents had nothing, did it say so?"

Module 9 checked one draft at a time. This lesson turns those checks into scores over a batch, so the November pilot gate rests on numbers. The Hollin data is simulated.

The rest of this course is yours to keep

This course is bought on its own, once, and stays readable afterwards, including the parts added to it later.