Doug Safreno’s Post

View profile for Doug Safreno, graphic

Co-founder, CEO at Gentrace

There's lots of hype about agentic RAG, but testing best practices are still the same: 1. Start with a factualness comparison to an expected answer with LLM-as-a-judge 2. Test each step of your RAG pipeline 3. If the first 2 steps don't work, break down the factualness eval into pieces One slight difference: With agentic RAG, the agent will choose the search query. You might want to eval that search query for relevance if the 3 recs above don't work for your app: https://lnkd.in/gtetE8HW

How to test RAG systems

How to test RAG systems

gentrace.ai

To view or add a comment, sign in

Explore topics