Overview
The Collibra AWS Glue ETL Lineage Connector enables Collibra Connect developers to connect to AWS Glue, and extract metadata from it. The main operations that are made available by this connector include:
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage (this is a custom operation, not offered out-of-the-box by AWS Glue)
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
More details
Release Notes
Initial release. Main features:
- Connector core implementation.
- Pagination for query operations.
- Support for proxy connection.
Added the following methods (operations):
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
- Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)
- Modified column type to match the original type from AWS Glue and added new field ‘transformedType’.
Changes:
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License Requirements
- Collibra Connect
Version 1.0.0
February 5, 2020
Release Notes
Initial release. Main features:
- Connector core implementation.
- Pagination for query operations.
- Support for proxy connection.
Added the following methods (operations):
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
- Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License Requirements
- Collibra Connect
Support is provided for the template as downloaded from the Marketplace, without changes to the way it works.
Leave a review
