Module 11: Monitoring and Reliability
1 min read·
What you need first
- PR-AUC, Brier and calibration (Module 3 lesson 3), the isolation forest (Module 3 lesson 2), latency percentiles (Module 8 lesson 3), the scoring service (Module 9) and shadow deployment (Module 10 lesson 2). The lab's Step 1 rebuilds Modules 1 to 10.
- No model calls and no keys. The Evidently UI as a service is a local step, not run here.
- If you already run drift, segment and late-label monitoring with alerts tuned on history, go to the lab.