How do you debug a RAG system that gives wrong answers?
LLM Engineer Interview Questions: Advanced RAG Techniques — Self-RAG, GraphRAG, Agentic RAG
Audio flashcard · 0:21Nortren·
How do you debug a RAG system that gives wrong answers?
0:21
Debug RAG by isolating each stage. First check whether the relevant documents exist in the index. Then verify that retrieval surfaces them by inspecting top-K results manually. If retrieval is fine, check whether the chunks contain enough context to answer. If they do, examine the prompt to see if the LLM is being instructed clearly. Most RAG bugs are retrieval bugs, not generation bugs.
docs.ragas.io