All Jargons

Machine Learning /neural-network

Neural Network

A model made of connected layers that apply learned weights, biases, and nonlinear transformations to map input values to an output.

Available formats

2 min read
On this page

Read

The useful mental model

A neural network is a chain of parameterized mathematical transformations. Each layer combines incoming values with learned weights and biases, applies an activation function, and passes new values forward. Training uses prediction error to adjust the parameters; inference reuses the learned values on new input.

In plain English

It passes numbers through layers of adjustable calculations, then training changes those adjustments when the prediction is wrong.

Where builders use it

  • 01Image and speech recognition
  • 02Forecasting and classification
  • 03Language and generative models

Why it matters

Neural networks can learn complex nonlinear patterns without a developer manually specifying every rule. Their outputs still depend on the architecture, training data, objective, parameter updates, and evaluation process.

Why now

Large language models, multimodal models, and many recognition systems are built from deep neural networks. Understanding layers and learned parameters makes the distinction between training, inference, and model behavior easier to reason about.

A common misconception

“A neural network is a literal digital copy of a biological brain.”

Terms such as neuron and layer are useful analogies. The implemented system is a set of mathematical operations and learned parameters, not a simulation of how a whole brain works.

See

See the mental model

The visual is generated from the same structured knowledge as the written explanation.

Visual modelsystem

Input values pass through a weighted layer and nonlinear activation to produce a prediction. During training, measured error feeds back to adjust the learned parameters.

The layer diagram is a mathematical mental model. Training adjusts parameters from measured error; inference uses those learned values on new input.

Watch

Watch the explainer

A short visual explanation built from the same reviewed knowledge object.

Neural Network: layered calculations learned from error

See input values cross weighted layers and nonlinear activations, then follow measured error backward as training adjusts parameters for later inference.

0:54
English captionsGenerated narrationOpen video
Read transcript

A team wants to route requests, but one rule cannot pick the right route. A simple score misses combinations, like low urgency and a risky topic. A neural network learns those patterns from examples. Each connection multiplies a value by a number, called a weight. A node adds its inputs, then applies a bend, so the result is not a straight line. Layers of nodes pass results forward, until the network scores each route. At first the weights are random guesses. In training, the prediction is compared with the right answer. The error flows backward, and the weights are nudged to shrink it. After many examples, the weights capture the patterns. When deployed, the weights stay fixed. It is math tuned on data, like a brain only in name.

Builder example

Learn a nonlinear routing boundary from examples

A workshop team wants to route each request from several numeric and categorical signals, where no single field or simple threshold identifies the correct route.

Failure

A hand-written linear score misses combinations such as low urgency with a high-risk topic, and adding more brittle rules makes the system harder to maintain.

Intervention

Train a small neural network on reviewed examples, use hidden layers with nonlinear activations, measure prediction loss, and adjust the weights through backpropagation.

Observable result

On a held-out evaluation set, the trained network separates route combinations that the linear rule missed, while production inference uses the fixed evaluated parameters.

Sources

Go deeper

Last researched 11 October 2026