Provides an async infrastructure to process distributed work chain.
Creating an abstraction on top of Kafka (called MQueues) with a standalone implementation based on Chronicle Queues.
Based on MQueues provides 2 patterns:
- a batched producer/consumer pattern dedicated to importer
- a Stream Computation pattern (taken from Concord Mesos, Google MillWheel or Kafka Processor) to chain tasks