MemotivaLLM Engineer Interview Questions: Advanced RAG Techniques — Self-RAG, GraphRAG, Agentic RAG

What is HyDE and how does it work?

LLM Engineer Interview Questions: Advanced RAG Techniques — Self-RAG, GraphRAG, Agentic RAG

Audio flashcard · 0:18

Nortren·

What is HyDE and how does it work?

0:18

HyDE stands for Hypothetical Document Embeddings. Instead of embedding the user query directly, you ask an LLM to write a fictional document that would answer the query, then embed that hypothetical document. The hypothetical document tends to use vocabulary closer to actual documents than the original question, improving retrieval quality without any fine-tuning.
arxiv.org