Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-32921

Consider a higher default thread pool size for S3 SDK V2 Transfer Manager

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: S3
    • Tags:
    • Team:
      PLATFORM
    • Sprint:
      nxplatform next

      Description

      The TRANSFER_MANAGER_THREAD_POOL_SIZE_DEFAULT value, used as the default value for configuring the s3 transfer manager thread pool size, is 10.

      Nevertheless, while upgrading to AWS SDK V2 (NXP-32315), we have figured out that the SDK sets the pool size to 100 by default. See https://github.com/aws/aws-sdk-java-v2/blob/2.28.2/services-custom/s3-transfer-manager/src/main/java/software/amazon/awssdk/transfer/s3/internal/TransferManagerConfiguration.java#L81

      Should we consider a higher default Nuxeo value (if any) for performance and transfer speed sake?

      Consideration: we must have set this default value to 10 in the past after running benchmarks that told us it was the most suitable and sustainable under heavy import/export. This was however with SDK v1.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                grenard Guillaume Renard
                Participants:
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: