Overview
The Collibra AWS Glue ETL Lineage Connector enables Collibra Connect developers to connect to AWS Glue, and extract metadata from it. The main operations that are made available by this connector include:
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage (this is a custom operation, not offered out-of-the-box by AWS Glue)
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
More details
Release Notes
Changed:
- Updated the endpoints used to address the unknown host error when retrieving the job lineage.
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.5.1
- Java Runtime Environment 8
License and Usage Requirements
Collibra Connect
Version 1.2.0
May 6, 2020
Release Notes
Added:
- Functionality to use the AWS IAM Role Policy.
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License and Usage Requirements
Collibra Connect
Version 1.1.0
April 24, 2020
Release Notes
Added:
- Functionality to use a custom AWS Glue service endpoint.
- Support for custom KeyStore and TrustStore.
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License and Usage Requirements
Collibra Connect
Version 1.0.1
March 20, 2020
Release Notes
Initial release. Main features:
- Connector core implementation.
- Pagination for query operations.
- Support for proxy connection.
Added the following methods (operations):
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
- Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)
- Modified column type to match the original type from AWS Glue and added new field ‘transformedType’.
Changes:
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License and Usage Requirements
- Collibra Connect
Version 1.0.0
February 5, 2020
Release Notes
Initial release. Main features:
- Connector core implementation.
- Pagination for query operations.
- Support for proxy connection.
Added the following methods (operations):
- Get databases
- Get tables
- Get columns
- Get jobs
- Get job lineage
- Get tables for a specific database
- Get columns for a specific database
- Get tables for a set of databases
- Get columns for a set of databases
- Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)
Dependencies
- Mule ESB 4.2.0
- Anypoint Studio 7.3.4
- Java Runtime Environment 8
License and Usage Requirements
- Collibra Connect
Support is provided for the template as downloaded from the Marketplace, without changes to the way it works.
Leave a review
