AI Garage Jargons
Inference
The process of running a trained model to generate predictions or outputs.
Use Cases
- Real-time chatbot responses
- Batch classification jobs
- Recommendation scoring
ELI5
When the trained AI actually does the task for you.
Why it matters
Inference performance drives user experience and infrastructure cost.
Back to glossary/inference