-
Type: Task
-
Status: Resolved
-
Priority: Minor
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 9.2
-
Component/s: Events / Works, Streams
-
Epic Link:
-
Tags:
-
Sprint:nxcore 9.1.4, nxcore 9.2.2, nxcore 9.2.1
-
Story Points:5
Goal:
1. Test computation pattern on sensible code part
2. Offer a fail safe and unlimited work queue (only limited by disk space)
HowTo:
The impl is straightforward, each Work Queue is a stream (default, elasticsearch, ....), the size of the queue is the concurrency of the pool.
Create a generic computation that receive a record representing a work and that execute the work in the processRecord. Checkpoint on each work.
The topology is a set of sink computations.
The workmanager append records with the serialized work into the stream.