Track external system lineage information

Data lineage in Knowledge Catalog (formerly Dataplex Universal Catalog) lets you manually record lineage information for systems that aren't supported by automated data lineage tracking, such as external or on-premises databases. You can use the Data Lineage API to log custom processes, runs, and events that capture data movement and maintain a complete, end-to-end view of your data.

Record custom events

To track data movement when integrating with external or on-premises databases, create the following resources in order:

1. Create a process using the processes.create method.
2. Create a run using the processes.runs.create method.
3. Create a lineage event using the processes.runs.lineageEvents.create method.