# Decision Model

> Part of the AI Garage Jargons glossary: https://aigarage.in/jargons (all terms: https://aigarage.in/jargons.md)

**Category:** Machine Learning
**Tags:** agents, classification, decision-making, routing

A model designed to make structured judgments or choose between possible actions, returning scores or probabilities instead of primarily generating open-ended text.

**In plain terms:** A language model is often asked what to say next. A decision model is asked which option to choose, whether something is true, or how strongly something scores.

**Use cases:**
- Routing requests to the right workflow
- Checking whether an action meets a policy
- Scoring or ranking possible decisions

**Why it matters:** Agents often need many small, repeatable judgments. A specialized decision model can make those steps more explicit and structured instead of asking a general-purpose LLM to generate an answer every time.

**Why now:** Decision models are becoming easier to use inside normal AI stacks. Since version 0.35, Ollama has exposed Jev-style decision models through a dedicated endpoint, with local models for bounded choices, true-or-false judgments, and rubric scores.

**AI Garage example:** In an assistant like Shushi, a decision model could sit before the main language model and judge things such as: Is this message asking for a calendar action? Does the assistant have enough information to act? Should it reply, ask a follow-up question, or do nothing? The language model can then handle the parts that actually need language generation.

**Mental model:** A decision model is a gate in front of an action. It evaluates a bounded question and returns a structured judgment, so the rest of the system can follow a clear route.

**Builder scenario: Route a Shushi request before generation**

- **Context:** Shushi receives a message that may require a calendar action, a follow-up question, a normal reply, or no action.
- **Failure:** Sending every message directly to the main language model mixes routing decisions with language generation and makes the action boundary harder to inspect.
- **Intervention:** A decision model first scores the message against the allowed routes and returns the selected route as structured data.
- **Outcome:** Shushi can invoke the language model only when language is needed and handle the remaining routes with explicit workflow logic.

**Common misconceptions:**
- **Claim:** A decision model is just another name for a language model.
  **Correction:** A language model is commonly used to generate open-ended text. A decision model is used for bounded judgments such as choosing, ranking, scoring, or checking.

**Visual model (system):** The decision model makes the route explicit before any language is generated or action is taken.

**Visual description:** An incoming Shushi message passes through a decision model and is routed to a calendar action, follow-up question, generated reply, or no action.

**Related concepts:** [Large Language Model](https://aigarage.in/jargons/llm)

**Video explainer:** [Decision Model: a structured judgment before action](https://nqqbubjesbyuwrdhqxnk.supabase.co/storage/v1/object/public/aigarage-public-media/jargons/decision-model/v2/decision-model.mp4) (48 seconds)

See how a scheduling assistant scores four allowed options, returns a result that is only data, passes it through explicit workflow checks, changes the calendar, and only then asks a language model to write the confirmation.

**Published:** 2026-10-11T21:02:07+05:30
**Captions:** [English](https://aigarage.in/jargons/decision-model/captions.vtt)
**Narration:** generated

**Transcript:** A learner asks a scheduling assistant to move Friday's workshop to four.

It could reply right away, but replying is not the same as deciding.

First, a decision model steps in. It scores a fixed set of options and picks one.

Here, the four options are changing the calendar, asking a question, writing a reply, or doing nothing.

The scores settle, and the calendar option wins.

That result is just data. It does not change anything yet.

Ordinary workflow code checks the event, the person's permission, and the policy.

Only then does the calendar change.

Now a language model can write the confirmation.

A decision model makes one narrow judgment. Your workflow decides what that judgment is allowed to do.

**Last researched:** 2026-10-11

**Sources:**
- [Ollama now supports Jev-style decision models](https://ollama.com/blog/ollama-now-supports-jev-style-decision-models)
- [Ollama - Tev1 decision model and API reference](https://ollama.com/library/tev1)
- [Together AI - Tev1 training and evaluation repository](https://github.com/togethercomputer/tev1)

**URL:** https://aigarage.in/jargons/decision-model