Google Cloud BigQuery Bidirectional Integration
Overview
BigQuery is Google Cloud’s serverless, highly scalable, fully managed analytics data warehouse for large- or small-scale data. A variety of storage options are available, both in the cloud or for local files. With BigQuery, it is possible to quickly create, store, modify, find, and inspect your data and its corresponding data types.
This document presents a bidirectional integration between Google Cloud BigQuery and Collibra. The Google Cloud BigQuery to Collibra synchronization retrieves multiple projects, datasets, tables, columns, and data, which in turn are converted into Collibra assets. For the reverse direction – Collibra to Google Cloud BigQuery – the synchronization updates the Google Cloud BigQuery descriptions of the datasets, tables, and columns based on the information defined on the Collibra Platform. There is no need to enable the process manually – the built-in scheduler ensures that integrations are executed with consistency.
To receive support on this item, you can engage our Professional Services team or post any questions in the Data Citizens Community.
Media
More details
Release Notes
- Changed Authentication Scheduler from ‘FixedRate’ to ‘FixedDelay’
- Upgrade Spring Boot parent dependency to version 2.5.12
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Google Cloud BigQuery
License and Usage Requirements
- Collibra Catalog
- Google BigQuery
Release History
Release Notes
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Google Cloud BigQuery
License and Usage Requirements
- Collibra Catalog
- Google BigQuery
Release Notes
Updated the Log4j version from 2.16 to 2.17 due to vulnerabilities.
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Google Cloud BigQuery
License and Usage Requirements
- Collibra Catalog
- Google Big Query
Release Notes
Updated logger log4j2 dependency to Apache log4j2 version 2.16.0
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Platform v2021+
- Google Cloud BigQuery
License and Usage Requirements
- Collibra Catalog
- Google Big Query
Release Notes
– Added function to update Columns
– Column names marked obsolete on Collibra once renamed on Google Cloud BigQuery
– New Google Cloud BigQuery renamed column names will be marked as Candidate on Collibra
– Includes functionality to mark table and schema names obsolete on Collibra when updated, if Google Cloud BigQuery allows the option in the future
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
- Collibra Platform v2021+
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Platform v2021+
- Google Cloud BigQuery
- Spring Boot Framework
License and Usage Requirements
- Collibra Catalog
- Google BigQuery
Release Notes
Initial release:
Main features:
- synchronizes Google Cloud BigQuery to Collibra
- synchronizes Collibra to Google Cloud BigQuery
Compatibility
- Spring Boot Framework
- Eclipse IDE
- Collibra Cloud
- Collibra 5.7.5 and newer
- Collibra Platform v2021+
Dependency
- Java Runtime Environment 1.8
- Spring Boot Integration Library
- Collibra Platform v2021+
- Google Cloud BigQuery
- Spring Boot Framework
License and Usage Requirements
- Collibra Catalog
- Google BigQuery
To receive support on this item, you can engage our Professional Services team or post any questions in the Data Citizens Community.
The following terms shall apply to the extent you receive the source code to this offering.
Notwithstanding the terms of the Binary Code License Agreement under which this integration template is licensed, Collibra grants you, the Licensee, the right to access the source code to the integrated template in order to copy and modify said source code for Licensee’s internal use purposes and solely for the purpose of developing connections and/or integrations with Collibra products and services.
Solely with respect to this integration template, the term “Software,” as defined under the Binary Code License Agreement, shall include the source code version thereof. Except with respect to the foregoing, all remaining terms of the Binary Code License Agreement shall apply to the license of integration template hereunder.
