Google Cloud Dataflow is used to manage and execute various data processing patterns. This integration helps analysts, and data scientists understand where the data is coming from, where it has been, how it is being used and who is using it. As an example, it can be used to identify the root cause of bad data events, and checking regarding the impact analysis prior to making data changes.
This Spring Boot integration retrieves the job details (pipelines) from Google Cloud Dataflow, transforms, and upserts them to a Collibra Platform instance as assets and technical lineage.
Please contact your customer success advisor to gain access to this integration.