Databricks Unity Catalog metadata integration
Overview
Databricks Unity Catalog is a technical catalog on Databricks side that provides schema information for all the Databricks databases that are available in the connected Databricks instances.
If you integrate Databricks Unity Catalog, you integrate the metadata of all databases in the Databricks Unity Catalog metastore into Collibra Data Intelligence Cloud. The resulting assets represent the Databricks databases, schemas, tables and columns.
The Databricks Unity Catalog integration allows to get all the metadata from Databricks Unity Catalog into Collibra in one action, which means you quickly get an overview of all your Databricks databases in Collibra Data Intelligence Cloud. You can also register Databricks databases into Collibra Data Intelligence Cloud via the Databricks JDBC connection. However, you must register each database individually.
For more information, go to the documentation.
Media
More details
Release Notes
Databricks Unity Catalog file system integration via Edge is now generally available. This integration allows for the registration of Databricks Unity Catalog as a data source in Collibra and the synchronization of the metadata. After the synchronization, the files and directories of the Databricks Unity Catalog are represented in Collibra by specific asset types, retaining the original names.
Compatibility
- Databricks Unity Catalog
- Collibra Data Intelligence Cloud
Dependency
- N/A
License and Usage Requirements
Community
See existing Q&A in the Collibra Community
Browse discussions with customers who also use this app.
Start a New Topic in the Collibra Community
Collibra-hosted discussions will connect you to other customers who use this app.
Technical Support
Support and documentation is provided for all harvester integrations.
Create a support ticket.
Use of this integration requires the following licenses:
- Collibra Data Intelligence Cloud
- Metadata Integration
Please contact your sales representative or Customer Success Manager for more information.
Paul-Frederick Taylor
Great to be finally able to connect UC with the Catalog of Catalogs!