What is answer relevance in RAG evaluation?
LLM Engineer Interview Questions: LLM Evaluation, Hallucinations, Guardrails, Production Monitoring
Audio flashcard · 0:19Nortren·
What is answer relevance in RAG evaluation?
0:19
Answer relevance measures whether the generated answer actually addresses the user's question, regardless of whether it is grounded. A faithful answer can still be irrelevant if it answers a different question. Both faithfulness and relevance are needed; high faithfulness with low relevance means correct but useless answers, and high relevance with low faithfulness means useful but possibly fabricated answers.
docs.ragas.io