Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-23778

Stream WorkManager must be able to configure LogConfig per worker pool

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 9.3
    • Fix Version/s: QualifiedToSchedule
    • Component/s: Streams

      Description

      In 9.3 nuxeo.stream.work.log.config point to the LogConfig to use for all the worker pools.

      When choosing a Kafka LogConfig it means the same kafka producer/consumer properties for all worker pools.

      In the case of pool with slow or fast worker, we may need a different configurations.
      For instance when reindexing the entire repository, some work are slow because they are processing lots of documents, this means the max.poll.interval must be high and max.poll.records low. This will not suit very well for fast worker.

      Also being able to choose a LogConfig per workpool enable to mix local worker pool (using chronicle queue) and distributed worker pool (using kafka) in the same instance.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bdelbosc Benoit Delbosc
                Reporter:
                bdelbosc Benoit Delbosc
                Participants:
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 4 hours
                  4h