What is IVF indexing and when would you use it?

IVF stands for Inverted File index. It clusters vectors into partitions and only searches the most relevant partitions for each query. IVF is faster than HNSW for very large datasets and uses less memory but typically has slightly lower recall. It is often combined with product quantization, called IVF-PQ, for billion-scale vector search.