Unsupported Screen Size: The viewport size is too small for the theme to render properly.

JDBC Driver for Apache Spark

Published by: Collibra Catalog
Latest version: 24.0.8963
Released: July 15, 2024
Contact Publisher
PackageDocumentation
Commercial Offering

Your use of Commercial Offerings is governed by the terms and conditions of your commercial agreement with Collibra. Read more.

Overview

“Commercial Offerings” are offerings purchased as part of the Collibra Service. Use of Commercial Offerings may be subject to additional fees charged by Collibra.  Your use of Commercial Offerings is governed by the terms and conditions of your master commercial agreement with Collibra for the purchase of the Collibra Service. The warranties, support services and service levels referenced in such master agreement apply to Commercial Offerings.

The Apache Spark JDBC driver can be used in the Collibra Catalog in the section ‘Collibra provided drivers’ to register Apache Spark sources. Leveraging this driver, Collibra Catalog will be able to register database information and extract the structure of the source into its schemas, tables and columns.

Collibra JDBC drivers can retrieve the following database components:

  • Schemas
  • Tables
  • Views
  • Columns
  • Primary keys
  • Foreign keys

More details

Release Notes

July 2024 release with latest updates and, where relevant, bug fixes.

Compatibility
  • Collibra Data Intelligence Cloud
  • Collibra Data Intelligence On-Prem
Dependency
  • Apache Spark 1.6 and above
License and Usage Requirements

Release History

Version 23.0.8839
March 13, 2024
Release Notes

March 2024 release with latest updates and, where relevant, bug fixes.

Compatibility
  • Collibra Data Intelligence Cloud
  • Collibra Data Intelligence On-Prem
Dependency
  • Apache Spark 1.6 and above
License and Usage Requirements
Version 23.0.8771
January 5, 2024
Release Notes

January 2024 release with latest updates and, where relevant, bug fixes.

Compatibility
  • Collibra Data Intelligence Cloud
  • Collibra Data Intelligence On-Prem
Dependency
  • Apache Spark 1.6 and above
License and Usage Requirements
Version 23.0.8750
December 15, 2023
Release Notes

December 2023 release with latest updates and, where relevant, bug fixes.

Compatibility
  • Collibra Data Intelligence Cloud
  • Collibra Data Intelligence On-Prem
Dependency
  • Apache Spark 1.6 and above
License and Usage Requirements

Community

See existing Q&A in the Collibra Community

Browse discussions with customers who also use this app. 

Start a New Topic in the Collibra Community

Collibra-hosted discussions will connect you to other customers who use this app.

Technical Support

Support is provided for the template as downloaded from the Marketplace, without changes to the way it works. These drivers are designed to only work with Collibra Catalog and cannot be used for other purposes.

Submit a support ticket

Use of this solution requires a license to Collibra Data Intelligence Cloud and the purchase of Metadata Integrations at a volume commensurate with desired use. Please contact your sales representative or Customer Success Manager for more information.

Reviews

Rating

Noor basha Shaik

13345
on March 24, 2022

Is this driver nothing but the Apache Spark SQL driver? If so, the permissions needed on the data source (in this case Hive metastore?) are not explicitly mentioned in the documentation –

https://productresources.collibra.com/docs/collibra/latest/Content/Catalog/RegisterDataSource/JDBC/ref_db-connection-details-collibra-provided-driver.htm?catalog-connector-details=spark-sql

Marketplace Collibra

Admin
13345
on March 31, 2022

Hi @noorbashashaik, thanks for this feedback.
Here’s our answer:
1. This is Apache Spark SQL driver Provided by Collibra via our partner CData.
2. We have tested with Databricks Cloud which is running in Azure.
Please refer permissions on Databricks source here: Databricks documentation

Cheers,
Paulo

Leave a review