AI engineering glossary · Computing foundations
What is throughput?
Throughput: The amount of work completed per unit of time, such as requests served per second or megabytes moved per second. A system can have high throughput yet still respond slowly to each individual request, so it is different from latency.
Throughput: an example
A server that finishes 500 requests every second has a throughput of 500 requests per second.
Related terms
More Computing foundations terms
- Time zone
- Transistor
- Transport Layer Security
- Two's complement
- UDP
- Unicode
- Uniform Resource Locator
- Unix time
Where you learn it
Throughput is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.