Queuing and Buffering
The objective of this pattern is to provide reference implementations for queuing and buffering requests, in order to to achieve reliability i.e. minimal message loss in Collibra integration flows, when such robustness is needed. An an example, consider the scenario where data issues are flowing into Collibra DGC from Atlassian JIRA. In this scenario, message loss must be avoided. Ideally, the chronological order of messages also need to be maintained in order to ensure a first-in-first-out delivery to Collibra. In this scenario, it would be useful queue up requests from JIRA using a message queue. In this pattern, our examples are implemented using ActiveMQ. However, any other message queues may be used.
- The template is intended to be part of larger project, not standalone, for production.
- For demonstration purpose this package can be run independently to illustrate features.
- Anypoint Studio 6.x+
- Mule ESB runtime 3.8.x+
- For running the example only:
- ActiveMQ Server
- ActiveMQ dependency in pom.xml 5.6.x+
No previous versions of this listing is available.
This item has been published in the Solution Lab section of Collibra Marketplace. You may download and use this item free of charge. However, Collibra does not warranty or provide support for this item. Items in Solution Lab are shared with the wider data citizen community to stimulate the use and implementation of the Collibra platform. Also note that there is no commitment or agreement that the items in this section will be maintained or updated with new versions of the Collibra platform, Collibra Connect or any third party technology.
Check out the #developers channel on datacitizen.slack.com and connect with the community of the Collibra Marketplace developers.