AI engineering glossary · Data engineering
What is data profiling?
Data profiling: Examining a dataset to summarise its structure and content, such as data types, null counts, distinct values, ranges and common patterns. It reveals problems and informs the rules and transformations a pipeline needs.
Data profiling: an example
Profiling a loan file shows the age column has values up to 250 and 12 percent nulls, prompting validation rules.
Related terms
More Data engineering terms
- Data quality
- Data retention policy
- Data serialization
- Data skew
- Data SLA
- Data tiering
- Data validation
- Data vault
Where you learn it
Data profiling is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.