Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-26607

Fix default Kafka configuration for StreamWorkManager

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 10.3
    • Fix Version/s: 9.10-HF26, 10.10
    • Component/s: Streams

      Description

      When using the StreamWorkManager implementation with Kafka, the Kafka is configured with the default LogConfig:

      kafka.max.poll.interval.ms=60000
      kafka.request.timeout.ms=65000
      kafka.max.poll.records=5
      

      This will not work for a slow worker like OrphanVersionsCleanupListener which requires more than one minute on medium/large repository.
      The consequence of this misconfiguration can result in blocking completely the worker pool.

      A quick fix is to change the default Kafka config to use a higher poll interval like 60min.

      The Stream WorkManager may need a dedicated Log Configuration (and Kafka configuration) this will be handled in a dedicated ticket.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 0 minutes
                  0m
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 4 hours
                  4h