Talend ETL to Collibra Integration
Overview
Talend ETL helps you manage various steps involved in an ETL process, starting from the ETL design to the loading of the data. Ease of use,
high productivity and efficiency are ensured though a graphical user interface where you can map data between the source and target areas, as
well as a metadata repository from where existing work can be reused and repurposed.
This Spring Boot integration parses Talend ETL metadata, transforms, and upserts it to the Collibra Platform instance as assets. The supported connection types are:
- TalendMetadata:XmlFileConnection
- TalendMetadata:DelimitedFileConnection
- TalendMetadata:DatabaseConnection
Use cases
- Often, data is captured, transformed and sourced from Talend with little documentation. This Talend ETL integration will help you enhance your data lineage diagrams, data dictionaries, and business glossaries.
- In this way, you will gain increased trust and data citizen engagement around data streams that pass through, are collected by, or are produced in Talend.
- You can always be confident when planning and engaging with relevant business process owners, as the data center tracks changes in your Talend metadata.
Elements in Scope
The integration is designed to retrieve the following metadata:
- XML File Connection
- Delimited File Connection
- Database
- Table
- Database View
- Column
- Key-Value
To receive support on this item, you can engage our Professional Services team or post any questions in the Data Citizens Community.
Media
More details
Release Notes
- Added Docker files.
- Updated the Collibra Integration Library version to 1.1.10.
- Updated the Spring Boot version to 2.7.5.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
Release History
Release Notes
-
Fixed asset name delimiter property typographical error.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
-
Added a CMA file to set up the required Collibra metamodel.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
- Updated the Spring Boot Starter Parent version to 2.5.12 (CVE-2022-22965).
- Updated the Collibra Integration Library version to 1.1.5.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
Updated the Spring Boot Integration Library dependency version in the pom.xml file to v1.1.3 that supports the latest Collibra Platform versions (v2022.01+).
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
Updated the Log4j version from 2.16 to 2.17 due to vulnerabilities.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
Updated logger log4j2 dependency to Apache log4j2 version 2.16.0.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
- Added note regarding using an external KeyStore file
- Updated the log4j2.xml file to include the Collibra logger
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 8
- Spring Boot Integration Library
License and Usage Requirements
Release Notes
Initial release:
Spring Boot integration that parses Talend ETL metadata, transforms it and upserts it as assets on the Collibra Platform instance.
Compatibility
- Spring Boot Framework 2.5.0
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 8
- Spring Boot Framework 2.5.0
License and Usage Requirements
See existing Q&A in the Data Citizens Community
Browse discussions with customers who also use this app.
Start a New Topic in the Data Citizens Community
Collibra-hosted discussions will connect you to other customers who use this app.
The following terms shall apply to the extent you receive the source code to this offering.
Notwithstanding the terms of the Binary Code License Agreement under which this integration template is licensed, Collibra grants you, the Licensee, the right to access the source code to the integrated template in order to copy and modify said source code for Licensee’s internal use purposes and solely for the purpose of developing connections and/or integrations with Collibra products and services.
Solely with respect to this integration template, the term “Software,” as defined under the Binary Code License Agreement, shall include the source code version thereof. Except with respect to the foregoing, all remaining terms of the Binary Code License Agreement shall apply to the license of integration template hereunder.
