vector index
A data structure that makes nearest-neighbour search over many vectors fast, usually by giving up exactness.
In more detail
Flat indexes compare everything; HNSW and IVF indexes skip most comparisons. Every index trades recall, speed, memory and build time differently, and filtering interacts with each.
Related terms
- HNSW — An approximate vector index built as a layered graph of links between nearby vectors, searched by walking from a coarse top layer down to a dense bottom one.
- IVF index — An approximate vector index that clusters vectors into cells and searches only the cells whose centres are closest to the query.
- vector database — A database or extension that stores embedding vectors with their metadata and answers nearest-neighbour queries.
Taught in
- Vector Indexes And Databases — AI Engineering: LLM Apps, RAG & Agents
- How RAG Works And When To Use It — AI Engineering: LLM Apps, RAG & Agents
References
- FAISS wiki: Faiss indexes (IndexIVFFlat, nprobe, IndexHNSWFlat)
- Qdrant documentation: Indexing (HNSW and payload indexes)