Topic 3: Generation Metrics
9 min read·21 Sept 2026
Intuition: retrieval metrics judge the evidence; generation metrics judge the answer. They fail independently (Module 9, Topic 3.1).
| Metric | Question | Needs |
|---|---|---|
| Faithfulness | Is every claim supported by the context? | The context only |
| Answer relevance | Does it address the question asked? | The question only |
| Completeness | Does it contain all the required facts? | An answer key |
| Context precision | Were the passages we sent useful? | A judge |
| Context recall | Did the context contain the needed facts? | An answer key |
| Citation accuracy and coverage | Are citations real and on every claim? | The provided ids |
| Refusal correctness | Did it abstain exactly when it should? | Answerable or not |