The Databricks JDBC driver can be used in the Collibra Catalog in the section ‘Collibra provided drivers’ to register Databricks sources. Leveraging this driver, Collibra Catalog will be able to register database information and extract the structure of the source into its schemas, tables and columns.
Collibra JDBC drivers can retrieve the following technical metadata from the source:
- Primary keys
- Foreign keys
We plan to make the native Databricks JDBC Driver directly available on Marketplace, that is the driver will be downloadable straight from here without redirection to an external website. In the mean time, the JDBC Driver JAR can be downloaded from this page here: https://pages.databricks.com/ODBC-Driver-Download.html. The SparkJDBC42.jar can be found unzipping the JDBC Drivers directory available on the page
The driver has been certified with the username/password authentication scheme for the following:
- Ingestion of technical metadata from the source.
- Profiling of the registered data source and calculate statistics that describe the data.
- Collibra Platform 5.7.x
No previous versions of this listing is available.