Bluemetrix

BDM is a full-service Spark ETL based tool that allows data professionals to control and manage all aspects of data pipeline creation and operations. Built to integrate with Collibra’s enterprise-level data governance, BDM is packed full of intelligent automation that can automatically create, capture and maintain the data governance state of data assets in the pipeline whilst enforcing appropriate policies to the governed data. By automating data policies within BDM, you can ensure that your Collibra Platform is always up to date with the governed data in your data lake.

Together with Collibra, Bluemetrix empowers the following key stakeholders to

• Have data self-service access to consume the information in real-time.
• Remove manual implementation by automating, enforcing, and auditing access and security policies at a fine-grained level.
• Publish datasets and get complete visibility into how the data is being used, accessed and control
• Ensure all employees and users of data are aware of the responsibilities

Bluemetrix Data Policy Enforcement Capabilities:

• Data Policies are read and interpreted for all data sources in the pipeline
• An extensible rule-based engine exists in BDM to capture all policy implementations
• Policy implementation occurs automatically during the execution of the Write phase of the data pipeline
• There is no requirement for the data engineer to access or implement the policies – it happens automatically within the system

Data governance is a complex process that requires significant resources and time. When the governance runs independently of data pipelines, governance tends to fall out of sync. This can be frustrating and costly for the DG specialists responsible for managing the data.

To solve these problems, we created an ETL automation solution that integrates with Collibra Data Intelligence Cloud Platform, eliminating complexity across the entire data policy enforcement and management process. The BDM platform helps to improve the quality and governance of the pipelines produced for analytics and data science teams, with the business impact on the following:

• Gain better control and visibility over data by making it easier to capture rules in real time as they change.
• Get alerts when data privacy rules are violated and thereafter act before any negative impacts occur.
• Improve the underlying security of the data through the provision of highly secure and easy to use Tokenization functionality.
• Ensure all data activities comply with the required regulations they are operating to
• Ensure compliance activity is recorded and stored in usable manner
• Cost-effectively protect business applications and databases from the risk of data breaches and legal problems
• Consistency of data throughout the enterprise. Removes the disparate data management that often exists
• The audit trail is always available for accountability and responsibility

BDM is quickly deployable with a low footprint on any Edge node on your data lake.

Bluemetrix loads data from any of your pipelines to a Destination system of your choice, including Azure, AWS and Google Cloud.