AI engineering glossary · Deep learning core
What is bias term?
Bias term (also called Bias parameter, Intercept): A learnable constant added to a neuron's weighted sum before the activation function. It lets the neuron shift its output up or down independently of the inputs, so it can fire even when every input is zero. Not to be confused with statistical bias or unfairness.
Bias term: an example
A neuron computing w*x + b with w = 2 and b = -6 only produces a positive value once x exceeds 3.
Related terms
More Deep learning core terms
- Bidirectional RNN
- Binary cross-entropy
- Bottleneck
- Catastrophic forgetting
- Cell state
- Checkpoint
- Cross-entropy loss
- Curriculum learning
Where you learn it
Bias term is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.