Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-29677

Increase default number of partitions for Bulk Action and StreamWorkManager queues

    Details

    • Release Notes Summary:
      The default number of partitions is increased for Bulk Action and StreamWorkManager queues.
    • Tags:
    • Team:
      PLATFORM
    • Sprint:
      nxplatform #21, nxplatform #22
    • Story Points:
      1

      Description

      Some bulk actions are configured with very low defaultPartition resulting in a bulk command that hard to scale.

      For instance this the case for the recomputeViews and recomputeThumbnails bulk actions that define 2 partitions.
      The number of partition limits the maximum concurrency for the Nuxeo cluster, by default 2 is not enough to process large volume.
      This must be increased to 6 by default.

      The same thing, for the Stream WorkManager where the number of partitions is proportional to the maxThreads defined in the Work queue,
      with the exception when using maxThreads=1, in this case, we don't want any concurrency.
      Some Work queues should not be configured with maxThreads=1: pictureViewsGeneration, renditionBuilder, and videoConversion.
      using maxThreads=2 instead will results in creating 6 partitions (maxThreads * nuxeo.stream.work.over.provisioning.factor default over provisioning factor being 3).

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 4 hours
                  4h

                    PagerDuty

                    Error rendering 'com.pagerduty.jira-server-plugin:PagerDuty'. Please contact your Jira administrators.