All Jargons

Machine Learning /embeddings

Embeddings

Numeric vector representations of text, images, or other data that preserve useful patterns so related items can be compared by similarity or distance.

Available formats

2 min read
On this page

Read

The useful mental model

An embedding places each item at a point in a model-made map. Items the model considers related tend to land closer together, so a system can retrieve nearby candidates before working with their original content.

In plain English

A way to turn text into numbers so AI can compare meaning, not just exact words.

Where builders use it

  • 01Semantic search
  • 02Recommendation systems
  • 03RAG document retrieval

Why it matters

Embeddings let applications retrieve related material even when the query and source use different words. Their usefulness still depends on the embedding model, source quality, chunking, and retrieval design.

Why now

As builders connect AI systems to private documents and product data, embeddings remain a common foundation for semantic retrieval, recommendations, and RAG.

A common misconception

“Each embedding dimension is a human-readable feature such as price, topic, or sentiment.”

The dimensions are learned numerical features whose individual meanings are usually not interpretable. The useful signal comes from relationships between complete vectors.

See

See the mental model

The visual is generated from the same structured knowledge as the written explanation.

Visual modelsystem

A learner question about cohort cost sits closest to a passage about the program fee, while a schedule passage and an unrelated passage sit progressively farther away in the embedding map.

Embedding distance helps rank likely matches. The system still passes the original retrieved text to the next step.

Watch

Watch the explainer

A short visual explanation built from the same reviewed knowledge object.

Embeddings: find related meaning beyond exact words

See how a learner's question and approved source passages become vectors, settle into an illustrative similarity map, and lead the system back to the original supporting text.

0:53
English captionsGenerated narrationOpen video
Read transcript

A learner asks a workshop assistant, What does the builder cohort cost? The approved notes use different words: program fee. Exact keyword search can miss that match. An embedding model turns the question and each source passage into vectors, then places them in a learned numerical space. In this mental model, related meaning tends to land closer together. The program-fee passage moves nearest to the question, while the schedule and an unrelated passage stay farther away. Distance helps the system rank likely candidates. It then retrieves the original fee passage and gives that text to the answering model. The vector does not know the fee, prove the passage is true, or contain human-readable dimensions such as price and topic. It is a useful similarity signal. Embeddings help the system find where to look. The retrieved source still has to support the answer.

Builder example

Find the right workshop passage without exact keywords

A learner asks a workshop assistant, 'What does the builder cohort cost?' The approved notes describe the same topic as the 'program fee.'

Failure

An exact keyword search can miss the relevant passage because the question and source use different words.

Intervention

Embed the learner's question and the approved note chunks with the same embedding model. Retrieve the nearest chunks, then give their original text to the answering model.

Observable result

The program-fee passage appears among the retrieved candidates even though the question used the word 'cost,' and the final answer can be grounded in the source text.

Sources

Go deeper

Last researched 11 October 2026