Unsupported Screen Size: The viewport size is too small for the theme to render properly.
Published by Collibra Marketplace

AWS Glue ETL Lineage Connector (M4)

Package Documentation
Certified Free

Overview

The Collibra AWS Glue ETL Lineage Connector enables Collibra Connect developers to connect to AWS Glue, and extract metadata from it. The main operations that are made available by this connector include:

  • Get databases
  • Get tables
  • Get columns
  • Get jobs
  • Get job lineage (this is a custom operation, not offered out-of-the-box by AWS Glue)
  • Get tables for a specific database
  • Get columns for a specific database
  • Get tables for a set of databases
  • Get columns for a set of databases

Media

More details

Release Notes

Changed:

  • Updated the endpoints used to address the unknown host error when retrieving the job lineage.
Compatibility
  • Collibra Cloud
  • Collibra 5.7
  • Mule ESB 4.2.0
  • AnyPoint Studio 7.5.1
Dependency
  • Java Runtime Environment 8
License and Usage Requirements
  • Collibra Connect

Release History

Version 1.2.0
May 6, 2020
Release Notes


Added:

  • Functionality to use the AWS IAM Role Policy.
Compatibility
  • Collibra Platform 5.7 and newer
  • Mule ESB 4.2.0
  • AnyPoint Studio 7.3.4
Dependency
  • Java Runtime Environment 8
License and Usage Requirements
  • Collibra Connect
Package Documentation
Version 1.1.0
April 24, 2020
Release Notes

Added:

  • Functionality to use a custom AWS Glue service endpoint.
  • Support for custom KeyStore and TrustStore.
Compatibility
  • Collibra Platform 5.7 and newer
  • Mule ESB 4.2.0
  • AnyPoint Studio 7.3.4
Dependency
  • Java Runtime Environment 8
License and Usage Requirements
  • Collibra Connect
Package Documentation
Version 1.0.1
March 20, 2020
Release Notes

Initial release. Main features:

  • Connector core implementation.
  • Pagination for query operations.
  • Support for proxy connection.

Added the following methods (operations):

    • Get databases
    • Get tables
    • Get columns
    • Get jobs
    • Get job lineage
    • Get tables for a specific database
    • Get columns for a specific database
    • Get tables for a set of databases
    • Get columns for a set of databases
    • Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)

Changes:

  • Modified column type to match the original type from AWS Glue and added new field ‘transformedType’.
Compatibility
  • Collibra Platform 5.7 and newer
  • Mule ESB 4.2.0
  • AnyPoint Studio 7.3.4
Dependency
  • Java Runtime Environment 8
License and Usage Requirements
  • Collibra Connect
Package Documentation
Version 1.0.0
February 5, 2020
Release Notes

Initial release. Main features:

  • Connector core implementation.
  • Pagination for query operations.
  • Support for proxy connection.

Added the following methods (operations):

  • Get databases
  • Get tables
  • Get columns
  • Get jobs
  • Get job lineage
  • Get tables for a specific database
  • Get columns for a specific database
  • Get tables for a set of databases
  • Get columns for a set of databases
  • Functionally equivalent to AWS Glue ETL Lineage Connector v1.2.0 (Mule 3)
Compatibility
  • Collibra Platform 5.7 and newer
  • Mule ESB 4.2.0
  • AnyPoint Studio 7.3.4
Dependency
  • Java Runtime Environment 8
License and Usage Requirements
  • Collibra Connect
Package Documentation

Reviews

Rating
Leave a review