MemotivaLLM Engineer Interview Questions: LLM Evaluation, Hallucinations, Guardrails, Production Monitoring

What is answer relevance in RAG evaluation?

LLM Engineer Interview Questions: LLM Evaluation, Hallucinations, Guardrails, Production Monitoring

Audio flashcard · 0:19

Nortren·

What is answer relevance in RAG evaluation?

0:19

Answer relevance measures whether the generated answer actually addresses the user's question, regardless of whether it is grounded. A faithful answer can still be irrelevant if it answers a different question. Both faithfulness and relevance are needed; high faithfulness with low relevance means correct but useless answers, and high relevance with low faithfulness means useful but possibly fabricated answers.
docs.ragas.io