Unsupported Screen Size: The viewport size is too small for the theme to render properly.
Collibra Marketplace
Current Version
1.1.0
Target Industries
Any Industry
Who can set it up
Target Business Function
Any Business Function
Latest Release Date
September 25, 2018
Initial Release Date
July 13, 2018

AWS Glue ETL Lineage Integration

Download Documentation

Overview

As ETL developers use AWS Glue to move data around, AWS Glue allows them to annotate their ETL code to document where data is picked up from and where it is supposed to land i.e. source to target mappings. It is those source to target mappings and data lineage information that is read from ETL scripts in Glue and sent to Collibra Data Governance Center. This integration empowers ETL developers to properly communicate technical data lineage, directly from their code, without the necessity to blindly scan their code, which typically results in illegible data lineage diagrams.

 

More details

Release Notes

v1.1.0 –Sep 25, 2018

  • Included metamodel CAR file.

 

Dependencies
  • Collibra DGC 5.3.2
  • Collibra DGC connector 1.4.1
  • AWS Glue ETL Lineage Connector 1.0
  • Java Runtime Environment 1.8
  • Generic Asset Listener 1.1
  • Generic Record Mapper 1.0
  • Mule ESB 3.8.5
  • Anypoint Studio 6.4.4

 

License Requirements
  • Collibra Catalog or Data Dictionary
  • Collibra Connect
  • AWS Glue

 

Version 1.0.0 July 13, 2018
Release Notes

Initial release. List main features:

  • AWS Glue metadata ingestion.
  • Use of generic asset listener.
  • Use of generic record mapper.

 

Dependencies
  • Collibra DGC 5.3.2
  • AWS Glue ETL Lineage Connector 1.0
  • Java Runtime Environment 1.8
  • Generic Asset Listener 1.1
  • Generic Record Mapper 1.0
  • Mule ESB 3.8.5
  • Anypoint Studio 6.4.4

 

License Requirements
  • Collibra Catalog or Data Dictionary
  • Collibra Connect
  • AWS Glue

 

This item has been published in the Solution Lab section of Collibra Marketplace. You may download and use this item free of charge. However, Collibra does not warranty or provide support for this item. Items in Solution Lab are shared with the wider data citizen community to stimulate the use and implementation of the Collibra platform. Also note that there is no commitment or agreement that the items in this section will be maintained or updated with new versions of the Collibra platform, Collibra Connect or any third party technology.

Check out the #developers channel on datacitizen.slack.com and connect with the community of the Collibra Marketplace developers.

Leave a review