embedding vector
A list of numbers that represents a piece of text, or an image, so that items with similar meaning lie close together.
In more detail
An embedding model turns each chunk and each query into a vector of a fixed number of dimensions, such as 384 or 1,536. Similar meanings end up near each other, which is what semantic search relies on, but exact names, codes, numbers and negation are often blurred.
Related terms
- embedding model — A model that maps text to embedding vectors rather than generating text.
- cosine similarity — A similarity score between two vectors from the angle between them, from 1 for the same direction to -1 for opposite, ignoring their lengths.
- vector database — A database or extension that stores embedding vectors with their metadata and answers nearest-neighbour queries.
- semantic search — Searching by meaning: embedding the query and returning the stored items whose vectors are closest.
Taught in
- From Prompts To Context — AI Engineering: LLM Apps, RAG & Agents
- When Context Fails — AI Engineering: LLM Apps, RAG & Agents
- What An Embedding Is — AI Engineering: LLM Apps, RAG & Agents
- Embedding Models — AI Engineering: LLM Apps, RAG & Agents
- Vector Indexes And Databases — AI Engineering: LLM Apps, RAG & Agents
- Keyword And Hybrid Search — AI Engineering: LLM Apps, RAG & Agents
- Measuring Retrieval — AI Engineering: LLM Apps, RAG & Agents
- How RAG Works And When To Use It — AI Engineering: LLM Apps, RAG & Agents
- Chunking And Ingestion — AI Engineering: LLM Apps, RAG & Agents
- Retrieval That Finds The Right Thing — AI Engineering: LLM Apps, RAG & Agents
- Capstone: The Tasks Assistant — AI Engineering: LLM Apps, RAG & Agents
References
- OpenAI: Vector embeddings guide (dimensions parameter)
- Hugging Face: sentence-transformers/all-MiniLM-L6-v2 model card