An evaluation harness for RAG
Golden questions, retrieval and answer scoring, regression gates in CI. The project every other RAG project needs first.
ProjectComing soonAdvanced
What you will be able to do
- Build a golden set that reflects real users
- Score retrieval and generation separately
- Fail a merge that lowers the score
Tell me when it opens
One email from the letter when it goes live. Unsubscribe any time.
The announcement comes through the letter: one email when part 1 goes live, free like every first part. Unsubscribe any time from the email or your account.