AI engineering glossary · Inference serving optimisation
What is edge inference?
Edge inference: Running a trained model on the device that generates the data, such as a phone, camera or embedded board, rather than in a data centre. It reduces latency and bandwidth and protects privacy, but the model must fit tight limits on memory, power and compute.
Edge inference: an example
A retail camera detects empty shelves on its own chip and sends only alerts, not video, to the cloud.
Related terms
More Inference serving optimisation terms
Where you learn it
Edge inference is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.