Fivetran to Collibra Integration
Overview
Fivetran is a SAAS-based data integration service that helps you centralize data from disparate sources which you can manage directly from your browser. You can think about Fivetran as a data pipeline that allows you to connect, extract, and load data (and even perform post-transformation) into your data destination using supported connectors.
This Spring Boot integration extracts metadata from Fivetran and imports them to the Collibra Platform. The Fivetran entities that the integration will import as assets include:
- Fivetran Groups (as a community),
- Fivetran Destinations,
- Fivetran Connectors,
- Fivetran Tasks,
- Fivetran Warnings.
In addition to this, the integration will create relationships/links to the matching Catalog assets (Database, Schema, Table) which are ingested separately in Collibra using the Data Catalog.
Use Cases
- As a Data Engineer or Data Architect, I want to import Fivetran Destinations, Connectors, Tasks, and Warnings so I can visualize these Fivetran entities in Collibra and how they’re related to each other.
- As a Data Engineer or Data Architect, I want to link Fivetran Destinations, Connectors, Tasks, and Warnings to the ingested Catalog data assets so I can see an end-to-end lineage of the Connector data assets and the Destination data assets.
Elements in Scope
The integration is designed to retrieve the following elements:
- Group
- Destination
- Connector
- Connector Warnings
- Connector Tasks
To receive support on this item, you can engage our Professional Services team or post any questions in the Data Citizens Community.
Media
More details
Release Notes
-
Updated Docker file
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release History
Release Notes
- Removed security vulnerabilities
- Upgraded to Spring Boot version 2.7.5
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
- Added Dockerfile
- Upgraded to Spring Boot version 2.7.3
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
-
Updated CMA file
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
- Set integration to use Fivetran V1 REST API
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
- Mapping of relationships from Fivetran Connector assets to Data Catalog column assets
- Populating ‘Name in Source’ attribute in Data Catalog schema, table, and columns assets
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
-
Handling not present Fivetran config object in destinations and connectors
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Spring Boot Framework
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
- using addAttributeDefaultToEmpty string to add attributes to Collibra assets for Fivetran.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Spring Boot Framework
License and Usage Requirements
- Collibra Catalog
- Fivetran
Release Notes
Initial release.
Main features:
This Spring Boot integration extracts metadata from Fivetran and ingests it to the Collibra Platform. The integration handles the Destinations and Connectors ingestion, and the creation of links between Destination/Connector to Catalog Assets.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Spring Boot Framework
License and Usage Requirements
- Collibra Catalog
- Fivetran
See existing Q&A in the Data Citizens Community
Browse discussions with customers who also use this app.
Start a New Topic in the Data Citizens Community
Collibra-hosted discussions will connect you to other customers who use this app.
The following terms shall apply to the extent you receive the source code to this offering.
Notwithstanding the terms of the Binary Code License Agreement under which this integration template is licensed, Collibra grants you, the Licensee, the right to access the source code to the integrated template in order to copy and modify said source code for Licensee’s internal use purposes and solely for the purpose of developing connections and/or integrations with Collibra products and services.
Solely with respect to this integration template, the term “Software,” as defined under the Binary Code License Agreement, shall include the source code version thereof. Except with respect to the foregoing, all remaining terms of the Binary Code License Agreement shall apply to the license of integration template hereunder.
