Lesson 3: Teaching a model BrightCart's tickets

Module 6 · Lesson 3 · About 45 minutes · Needs: Lesson 1 (what a transformer is), Module 3 (train and test sets)

The situation

Priya has 40 tickets her agents have sorted into four categories: refund, shipping, warranty and other. She wants the assistant to sort new ones the same way. Module 3 did this with a bag of words. Now you have a pretrained transformer: how do you teach it her categories without teaching it English again?

This lesson follows one ticket, "The dock light won't turn on any more, it's 8 months old." (label: warranty), through tokenizing, two kinds of fine-tuning and compression. Every number comes from a run on a laptop CPU.