Topic 4: Operating Embeddings
14 min read·21 Sept 2026
4.1 Batching, Concurrency, and Rate Limits at Index Time
Intuition: embedding a corpus is like mailing 100,000 letters. Send them in bundles (batching), use several post offices at once (concurrency), respect each office's opening hours (rate limits), and try again when a queue is full (retries).