Intermediate · Data
Data Lineage
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. The lifecycle of data, including its origin, transformations, and where it moves over time.
Technical Definition
The lifecycle of data, including its origin, transformations, and where it moves over time.
How it works
Data lineage provides a complete audit trail of data, detailing where it came from, how it was processed, and where it ultimately resides. This is crucial for data governance, compliance, troubleshooting, and ensuring data quality and trustworthiness in AI systems, especially when dealing with sensitive or critical enterprise data.