AI engineering glossary · Deep learning core
What is maxout?
Maxout: An activation that computes several linear functions of its input and returns the largest of them. It can learn its own piecewise-linear shape, of which ReLU is a special case, at the cost of multiplying the parameter count.
Maxout: an example
A maxout unit with 2 pieces takes max(w1*x + b1, w2*x + b2).
Related terms
More Deep learning core terms
- Mixed precision training
- Model parallelism
- Multi-task learning
- Multilayer perceptron
- Negative log-likelihood
- Neural network pruning
- Neural tangent kernel
- Neuron
Where you learn it
Maxout is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.