Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-17780

Make Upload API Cluster Aware

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.10
    • Component/s: File Upload , Nuxeo Drive

      Description

      The `BatchManager` handles a structure that is basically a list of streams that will be used within a transaction.

          batchId => List<File>

      If we add chunking, we have a more complex structure

          batchId => List<List<FileChunk>>

      This data (structure and streams) must be shared across Nuxeo nodes if we want the whole system to work across the cluster without having to enforce affinity.

      The initial implementation being for JSF, this was not so much of an issue, but it is now critical since we are using this very same endpoint :

      • for Nuxeo Drive
      • for Rest API

      This looks like a new use case for the TransientStore providing an abstraction API on top of :

      • memory or Redis for the structure
      • FS or S3 for the streams

        Attachments

          Issue Links

          depends on

          Improvement - An improvement or enhancement to an existing feature or task. NXP-17885 Use TransientStore for batch upload

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NXP-18050 Refactor and finalize TransientStore

          • Major - Major loss of function.
          • Resolved
          is required by

          Bug - A problem which impairs or prevents the functions of the product. NXDRIVE-353 Drive doesn't work against a Nuxeo cluster

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. NXP-16950 Improve and Extend Upload API

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Task - A task that needs to be done. NXP-18034 Remove @Experimental from TransientStore API

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: