Topic 3: Sizing and Overlap
6 min read·21 Sept 2026
3.1 Choosing Chunk Size: Embedding Limits and the Generator's Budget
Intuition: A chunk has to fit through two doors: the embedding model's input limit, and the LLM's context budget once you retrieve several chunks.