Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-30595

make S3 transfer parameters configurable

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 10.10
    • Fix Version/s: 10.10-HF54, 2021.11
    • Component/s: S3
    • Release Notes Summary:
      All the S3 multipart upload and copy parameters are configurable through nuxeo.conf.
    • Tags:
    • Backlog priority:
      800
    • Upgrade notes:
      Hide

      The nuxeo.s3.multipart.copy.part.size ConfigurationService property, formerly contributed in configuration-properties.xml, is deprecated since 2021.11/10.10-HF54.

      The new nuxeo.s3storage.multipart.copy.part.size nuxeo.conf property should be used instead, default value hasn't changed: 5242880 (5 MB).

      If you have contributed a custom nuxeo.s3.multipart.copy.part.size ConfigurationService property with an XML component such as:

        <extension target="org.nuxeo.runtime.ConfigurationService" point="configuration">
    <property name="nuxeo.s3.multipart.copy.part.size">xxxx</property>
  </extension>

      you need to remove it and replace it by nuxeo.s3storage.multipart.copy.part.size=xxxx in nuxeo.conf. Though, backward compatibility is kept.

      The following nuxeo.conf properties have been added:

      • nuxeo.s3storage.multipart.copy.threshold, default value: 5368709120 (5 GB)
      • nuxeo.s3storage.multipart.upload.threshold, default value: 16777216 (16 MB)
      • nuxeo.s3storage.minimum.upload.part.size, default value: 5242880 (5 MB)
      Show
      The  nuxeo.s3.multipart.copy.part.size ConfigurationService property, formerly contributed in configuration-properties.xml, is deprecated since 2021.11/10.10-HF54. The new nuxeo.s3storage.multipart.copy.part.size nuxeo.conf property should be used instead, default value hasn't changed: 5242880 (5 MB). If you have contributed a custom  nuxeo.s3.multipart.copy.part.size ConfigurationService property with an XML component such as: <extension target="org.nuxeo.runtime.ConfigurationService" point="configuration"> <property name="nuxeo.s3.multipart.copy.part.size">xxxx</property> </extension> you need to remove it and replace it by nuxeo.s3storage.multipart.copy.part.size=xxxx in nuxeo.conf. Though, backward compatibility is kept. The following nuxeo.conf properties have been added: nuxeo.s3storage.multipart.copy.threshold , default value: 5368709120 (5 GB) nuxeo.s3storage.multipart.upload.threshold , default value: 16777216 (16 MB) nuxeo.s3storage.minimum.upload.part.size , default value: 5242880 (5 MB)
    • Sprint:
      nxplatform #46
    • Story Points:
      2

      Description

      Please make minimumUploadPartSize, multipartUploadThreshold, and multipartCopyThreshold configurable as it was done for multipartCopyPartSize in NXP-26899.

        Attachments

          Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. NXP-28460 New implementation S3BlobProvider

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NXP-26899 S3 multipart part size should be configurable

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NXP-30797 setUserAgentPrefix in S3 config

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          Is referenced in

          [Captain Hook] PR for 1.9_10.10: #35 PR for 1.9_10.10: #35

          [Captain Hook] PR for 10.10: #4965 PR for 10.10: #4965

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: