Populate database with result of Collibra Output Module API
Overview
Some integration use cases related to the Collibra platform require structured content to be exported from Collibra using the Output Module API and processed further, for example, by being written to a database or a file. The goal of this integration template is to demonstrate how to best implement this type of use case. At the same time, the Output Module API cannot be used for all types of export use cases. You can consult with a qualified solution architect that has experience on the topic, who can provide you with an analysis as to whether the usage of the Output Module API is justified. Typically, to export content from the Collibra platform, you need to take into account the following factors before opting for a particular API:
- The volume of the data in scope, for example, thousands of records or hundreds of thousands.
- The frequency of the export, for example, on-demand, daily, weekly, and so on.
- The nature of the data being exported, for example, assets, responsibilities, workflows.
Analysis of the above factors will determine if the Output Module API is appropriate for your use case. There are alternative methods such as the Collibra Reporting Data Layer (Insights) that may better suit your data export requirements.
Elements in Scope
Asset Types
The assets that are synchronized between your Collibra environment and the in-memory database are assets of type Code Value and Issue.
Relation Types
This section outlines the relation types that are synchronized:
- Code Value groups/is grouped by Code Value
- The issue impacts/impacted by Asset
To receive support on this item, you can engage our Professional Services team or post any questions in the Data Citizens Community.
Media
More details
Release Notes
- Removed security vulnerabilities
- Upgraded to Spring Boot version 2.7.5
- Docker file added
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
- Collibra Data Intelligence On-Prem
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Data Intelligence Cloud API v2
License and Usage Requirements
Release History
Release Notes
- Updated the Spring Boot Starter Parent version to 2.5.12
- Updated the Collibra Integration Library version to 1.1.5
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Data Intelligence Cloud API v2
License and Usage Requirements
Release Notes
– Refactoring according to standard-reference template.
– File Structuring of Components and Services
– Constructor Autowiring
– Adding Constants
– Fixing Type Warnings
– Exception Handling
– Lombok
– Sync Lock
– Adding AppConfig
– Updating Authentication Config
– Main Service with ETL format
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Data Intelligence Cloud API v2
License and Usage Requirements
Release Notes
Initial release:
Spring Boot integration designed to retrieve data from a Collibra Platform instance domain, transform it, and insert it into the database.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Data Intelligence Cloud
Dependency
- Java Runtime Environment 8
- Collibra Data Intelligence Cloud API v2
- Collibra Platform v2021+
- Spring Boot Integration Library
License and Usage Requirements
See existing Q&A in the Collibra Community
Browse discussions with customers who also use this app.
Start a New Topic in the Collibra Community
Collibra-hosted discussions will connect you to other customers who use this app.
The following terms shall apply to the extent you receive the source code to this offering.
Notwithstanding the terms of the Binary Code License Agreement under which this integration template is licensed, Collibra grants you, the Licensee, the right to access the source code to the integrated template in order to copy and modify said source code for Licensee’s internal use purposes and solely for the purpose of developing connections and/or integrations with Collibra products and services.
Solely with respect to this integration template, the term “Software,” as defined under the Binary Code License Agreement, shall include the source code version thereof. Except with respect to the foregoing, all remaining terms of the Binary Code License Agreement shall apply to the license of integration template hereunder.
Scott Nichols
FYI … We noticed you need Spring 2.6.0 to get a clean startup. I mention because it doesn’t mention this in docs.
Marketplace Collibra
AdminHi Scott,
Thanks for the feedback, we’ll adapt the documentation accordingly.
Cheers,
The Marketplace team