IBM InfoSphere DataStage
Overview
IBM InfoSphere DataStage is one of the lineage scanners integrated into Collibra Data Lineage. The scanner automatically extracts lineage at an attribute level including transformation details – from commonly used DataStage ETL components including SQL overrides and transformation details.
Collibra Data Lineage supports IBM InfoSphere DataStage transformation logic.
- Lineage harvester. To create a connection you need to prepare a folder with all data objects that you want to process.
- Technical lineage via Edge. The Shared Storage connection is equivalent to the folder connection type when you use the lineage harvester. For lineage via Edge, you also need to create a connection to prepare a folder with all data objects that you want to process.
For business users, a summary lineage view is available in Collibra Catalog. More advanced users can explore a technical lineage view which includes details such as staging and temporary tables in addition to the transformation code.
More details
Release Notes
Recent improvements include the addition of an ANALYZE_ERROR called “CONFIGURATION” if there are undefined connection values in the source_id.conf file. Beneficiaries can copy and paste, overwriting their existing source_id.conf. See Prepare an external directory folder for the lineage harvester.
Compatibility
- Collibra Data Intelligence Cloud
Dependency
- Collibra Lineage Harvester
License and Usage Requirements
Community
See existing Q&A in the Data Citizens Community
Browse discussions with customers who also use this app.
Start a New Topic in the Data Citizens Community
Collibra-hosted discussions will connect you to other customers who use this app.
Technical Support
Support and documentation is provided for all harvester integrations.
Create a support ticket.
Use of this integration requires the following licenses:
- Collibra Data Intelligence Cloud
- ETL license
Please contact your sales representative or Customer Success Manager for more information.
