AI engineering glossary · Deep learning core
What is reLU?
ReLU (also called Rectified linear unit): The rectified linear unit, an activation that outputs the input if it is positive and zero otherwise: max(0, x). It is cheap to compute, avoids saturation for positive values and became the default in many deep networks.
ReLU: an example
ReLU(-3) = 0 and ReLU(4.2) = 4.2.
Related terms
More Deep learning core terms
Where you learn it
ReLU is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.