# Embeddings

> Part of the AI Garage Jargons glossary: https://aigarage.in/jargons (all terms: https://aigarage.in/jargons.md)

**Category:** Machine Learning
**Tags:** vector, retrieval, search

Numeric vector representations of text, images, or other data that preserve useful patterns so related items can be compared by similarity or distance.

**In plain terms:** A way to turn text into numbers so AI can compare meaning, not just exact words.

**Use cases:**
- Semantic search
- Recommendation systems
- RAG document retrieval

**Why it matters:** Embeddings let applications retrieve related material even when the query and source use different words. Their usefulness still depends on the embedding model, source quality, chunking, and retrieval design.

**Why now:** As builders connect AI systems to private documents and product data, embeddings remain a common foundation for semantic retrieval, recommendations, and RAG.

**AI Garage example:** An AI Garage workshop assistant could embed approved workshop notes and a learner's question, retrieve the nearest source passages, and pass the original text of those passages to the answering model.

**Mental model:** An embedding places each item at a point in a model-made map. Items the model considers related tend to land closer together, so a system can retrieve nearby candidates before working with their original content.

**Builder scenario: Find the right workshop passage without exact keywords**

- **Context:** A learner asks a workshop assistant, 'What does the builder cohort cost?' The approved notes describe the same topic as the 'program fee.'
- **Failure:** An exact keyword search can miss the relevant passage because the question and source use different words.
- **Intervention:** Embed the learner's question and the approved note chunks with the same embedding model. Retrieve the nearest chunks, then give their original text to the answering model.
- **Outcome:** The program-fee passage appears among the retrieved candidates even though the question used the word 'cost,' and the final answer can be grounded in the source text.

**Common misconceptions:**
- **Claim:** Each embedding dimension is a human-readable feature such as price, topic, or sentiment.
  **Correction:** The dimensions are learned numerical features whose individual meanings are usually not interpretable. The useful signal comes from relationships between complete vectors.

**Visual model (system):** Embedding distance helps rank likely matches. The system still passes the original retrieved text to the next step.

**Visual description:** A learner question about cohort cost sits closest to a passage about the program fee, while a schedule passage and an unrelated passage sit progressively farther away in the embedding map.

**Related concepts:** [RAG (Retrieval-Augmented Generation)](https://aigarage.in/jargons/rag), [Token](https://aigarage.in/jargons/token)

**Video explainer:** [Embeddings: find related meaning beyond exact words](https://nqqbubjesbyuwrdhqxnk.supabase.co/storage/v1/object/public/aigarage-public-media/jargons/embeddings/v2/embeddings.mp4) (47 seconds)

See how a learner's question and approved source passages become vectors, settle into an illustrative similarity map, and lead the system back to the original supporting text.

**Published:** 2026-10-12T11:59:38+05:30
**Captions:** [English](https://aigarage.in/jargons/embeddings/captions.vtt)
**Narration:** generated

**Transcript:** A learner asks an assistant what the builder cohort costs.

The notes say program fee, so a keyword search for cost can miss them.

An embedding model turns the question and each passage into a list of numbers.

Those lists place meaning on a map, where similar ideas sit close together.

The program fee passage lands nearest to the question.

The schedule and an unrelated passage stay farther away.

That distance ranks the likely matches.

Then the system fetches the original passage and gives it to the answering model.

The numbers do not hold the fee, and they prove nothing.

They are only a similarity signal.

Embeddings help find where to look. The source still has to support the answer.

**Last researched:** 2026-10-11

**Sources:**
- [OpenAI API - Vector embeddings](https://developers.openai.com/api/docs/guides/embeddings)
- [Google Cloud - Get text embeddings](https://docs.cloud.google.com/vertex-ai/generative-ai/docs/embeddings/get-text-embeddings)

**URL:** https://aigarage.in/jargons/embeddings