Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-32702

Make bulk scroller use a specific Kafka configuration

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2021.0, 2023.0
    • Fix Version/s: 2025.x, 2021.58, 2023.16
    • Component/s: Streams
    • Release Notes Summary:
      The Bulk Scroller is now using a slow consumer Kafka configuration
    • Tags:
    • Backlog priority:
      750
    • Team:
      PLATFORM
    • Sprint:
      nxplatform #118
    • Story Points:
      3

      Description

      The bulk scroller is configured with a 48-hour timeout (nuxeo.core.bulk.scroller.transactionTimeout=2d) because we know that scrolling an entire repository can take a long time.

      However the corresponding Kafka poll interval is using the default value (kafka.max.poll.interval.ms=7200000) which is common from all topics.

      This ticket is to request a custom configuration for the scroller to use a dedicated Kafka configuration where the pool interval is configured to the same value as the transaction timeout.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: