Lesson 5: What one answer costs, and how fast it arrives

Module 7 · Lesson 5 · About 45 minutes · Needs: Lesson 1 of this module (the classifier), Module 5 Lesson 1 (tokens), Module 6 Lesson 5 (prefill and decode)

The situation

Marta from Finance sends one line: "What does one BrightCart conversation cost?" Nobody has added up the bill. Priya has the volume, about 2,000 customer messages a day, and a complaint: in testing, customers stared at an empty chat box while the model worked, and some gave up.

This lesson answers both with real numbers. You will take one request, ticket 4 from the shared tickets ("When will my refund show up on my card?"), count its tokens, price it and scale it to a month. Then you will make it cheaper and make it feel faster.