ProjectIntent Over Keywords: From Stitched Embeddings to a Production Fashion Agent · Module 7: One embedding space with Gemini Embedding 2 · part 9 of 26
Part 9 · Module 7: One embedding space with Gemini Embedding 2

Module 7: One embedding space with Gemini Embedding 2

20 min read·
About 45 minutes · Needs: Module 3 (CLIP and cosine similarity), Module 5 (two collections and rank fusion), Module 6 (the "almost correct" failure) · Code: part2-video-rag-unified/src/embedders/gemini_embedder.py, part2-video-rag-unified/src/core/config.py

Where this fits

WHERE THIS FITS Intent Over Keywords this module PART 1: STITCHED VIDEO RAG three models, two spaces, RRF PART 2: UNIFIED VIDEO RAG one model, one space PART 3: STYLEME FastAPI, LangGraph, React QUALITY AND OPERATIONS evals, Docker, Cloud Run Frames ffmpeg, one per 5 s CLIP ViT-B/32 frames + text, 512 d Whisper base speech to text MiniLM 64-word chunks, 384 d Two collections p1_visual, p1_text Rank fusion RRF, k = 60 Gemini answer from transcript text API + Streamlit upload, ask, sources Windows ffmpeg, video + audio Embedding 2 Gemini, one vector One collection p2_unified, no fusion Notes + answer Gemini, cited times React web chat, photo, chips nginx one URL, /api proxy FastAPI /api/chat, limits Sessions in memory, cap of 3 Planner intent before retrieval Implementer batched embed, search Generator stylist reply, ids Grounding check no LLM, drops invented Gemini flash-lite, embedding 2 Qdrant styleme_products Catalogue ingest image + title vectors Langfuse optional traces Test video 26 questions, 4 kinds Video eval Part 1 vs Part 2 Agent evals intent, grounding Guards uploads, limits, secrets Containers compose profiles Cloud Run StyleMe only CI/CD GitHub Actions, WIF Original code v1, v2, fashion-agent
This module (highlighted): Part 2's embedding model and the one collection it fills. Amber marks a model, blue our own code.

Part 2 starts here. Module 6 diagnosed the failure: the stitched design finds the right moment for "Which service did Tidewater remove in March?" and still cannot say "Label Printer", because the picture and the speech were ranked in two separate spaces and only their ranks were fused. This module is about the one decision that changes that: a single embedding model that reads a window of video and its speech together and returns one vector. Module 8 covers how the windows are cut and what the model really ingests; Module 9 covers the one collection and the answers.

The rest of this project is yours to keep

This project is bought on its own, once, and stays readable afterwards, including the parts added to it later.

Or open everything with a plan