Type: New Feature
Affects Version/s: None
Fix Version/s: 10.10-HF68, 2023.x, 2021.28
Today the makeBlob computation that materializes the CSV export, is waiting for the completion of the file to checkpoint its position and send downstream the file into the transientstore.
When there are multiple concurrent exports the checkpoint is done when all the files are completed, this is a problem if an export can not be completed (because of an unexpected failure upstream). In this case all exports are blocked.
A failure on an export should not block other exports.
To fix this it requires:
- to use the option produceImmediate=true for the makeBlob computation, so a file is sent downstream when completed even if there are other file in progress
- to monitor incomplete files without activity for a period of time (1h), trace an error message and complete the export in error (with the partial file).