Amazon S3 object storage and AWS Glue integration with the Collibra Data Governance and Catalog solution will provide instant automation of data provisions from virtual data lakes in Amazon S3 to support cloud-enabled data governance through Collibra. Through the Amazon S3 object storage and AWS Glue serverless data discovery and processing combination, Collibra customers are empowered with enterprise-wide data governance and catalog capabilities from any system (remote desktop, mobile phone, IoT device, and more) — enabling business users to easily find, understand, collaborate and trust data residing in their data lake.
AWS S3 documentation:
AWS S3 improvements:
- Granular selection of objects to register in Catalog
- Improved crawler cleanup
- Crawler name validation
- Store the Glue database name and table name
Collibra Platform 5.5.x, 5.6.x and 5.7.x