AI engineering glossary · Data engineering
What is data ingestion?
Data ingestion: The step of collecting data from its origin, such as databases, files, APIs or event feeds, and bringing it into a storage or processing system. It can run in scheduled batches or continuously, and its reliability sets the ceiling for everything downstream.
Data ingestion: an example
Ingesting GST invoice CSVs dropped in a folder every night into an S3 bucket, along with a tag recording when each file arrived.
Related terms
More Data engineering terms
Where you learn it
Data ingestion is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.