AI engineering glossary · Deep learning core
What is neuron?
Neuron (also called Artificial neuron, Unit, Node): The basic computing unit of a neural network. It multiplies each of its inputs by a weight, sums them, adds a bias and applies an activation function to produce one output number. Loosely inspired by biological nerve cells, but it is just a small formula.
Neuron: an example
A neuron with inputs [2, 3], weights [0.5, -1] and bias 1 computes 2*0.5 + 3*(-1) + 1 = -1 before its activation is applied.
Related terms
More Deep learning core terms
- One-cycle policy
- Optimiser
- Orthogonal initialisation
- Output layer
- Parametric ReLU
- Recurrent neural network
- ReLU
- RMSNorm
Where you learn it
Neuron is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.