What chunking strategies are commonly used?
LLM Engineer Interview Questions: RAG Pipeline Design, Chunking Strategies, Hybrid Retrieval
Audio flashcard · 0:20Nortren·
What chunking strategies are commonly used?
0:20
Common strategies include fixed-size chunking by character or token count, recursive chunking that respects document structure like paragraphs and sections, semantic chunking that splits on topic shifts using embeddings, and document-specific chunking that uses native structure like markdown headers or HTML elements. Production systems often combine recursive and semantic strategies.
docs.llamaindex.ai