Lesson 2: Seeing what production is doing
34 min read·
Module 13 · Lesson 2 · About 55 minutes · Needs: Module 9 lesson 6 (span trees) and Module 10 lesson 6 (release bundles). One optional hosted call
The situation
Week 13. On 29 September the Ask prompt went from v7 to v8, and the bill rose for days before Ana asked why. Nothing put the logs, versions and money side by side. Helen wants the platform to notice next time; Ana wants spend by tenant; Gareth asks how you would know it got worse.
The running example is trace ask-1131 from guide 06: a Tallis Retail Group employee on Wednesday 30 September at 08:11 UTC, served by bundle b-639c719b (prompt ask-v8, config cfg-12), 2,876 input tokens, 429 output, 2,946 ms.