Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-31318

csvExport makeBlob computation should be more resilient by default

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 10.10-HF68, 2023.0, 2021.28
    • Component/s: Streams

      Description

      Today the makeBlob computation that materializes the CSV export, is waiting for the completion of the file to checkpoint its position and send downstream the file into the transientstore.

      When there are multiple concurrent exports the checkpoint is done when all the files are completed, this is a problem if an export can not be completed (because of an unexpected failure upstream). In this case all exports are blocked.

      A failure on an export should not block other exports.

      To fix this it requires:

      • to use the option produceImmediate=true for the makeBlob computation, so a file is sent downstream when completed even if there are other file in progress
      • to monitor incomplete files without activity for a period of time (1h), trace an error message and complete the export in error (with the partial file).

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: