What is chunk overlap and why is it used?
LLM Engineer Interview Questions: RAG Pipeline Design, Chunking Strategies, Hybrid Retrieval
Audio flashcard · 0:18Nortren·
What is chunk overlap and why is it used?
0:18
Chunk overlap is the practice of including the last few tokens of one chunk at the start of the next. Typical overlaps are 10 to 20 percent of chunk size. Overlap helps preserve context across boundaries so that a query about a sentence near a chunk edge can still match. It comes at the cost of duplicated content and slightly larger storage.
docs.llamaindex.ai