Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-24388

Stream processing consumer group should be prefixed

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 9.10
    • Fix Version/s: 9.10-HF03, 10.1
    • Component/s: Streams

      Description

      The same stream processor can be used with different log configuration in different nodes.

      A use case for this is to have a Nuxeo node processing the async work from a mass import and another Nuxeo node processing the async work coming from the Web UI.

      The StreamWorkManager will have a different Kafka Log configuration on each node so they are using different topic names.

      The Kafka consumer group is not prefixed, this does not prevent the nodes to work as expected.
      But it will be better to not share the group name to prevent irrelevant balancing or to prevent blocking of adminitration operation (move consumer positions of one node while another node is running)

      So the consumer group should use the same prefix as the log name.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 2 hours
                2h