AI engineering glossary · Computing foundations
What is parallel computing?
Parallel computing: Carrying out multiple computations at literally the same moment on separate processing units, such as several CPU cores or GPU cores. It speeds up tasks that can be split into independent pieces.
Parallel computing: an example
Adding two arrays of a million numbers can be split so a GPU adds thousands of pairs simultaneously.
Related terms
More Computing foundations terms
Where you learn it
Parallel computing is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.