Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-24634

Rely on Kafka brokers only, remove Zookeeper dependency

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 9.10, 10.1
    • Fix Version/s: 9.10-HF04, 10.2
    • Component/s: Streams

      Description

      Today zookeeper access is used to list topics, check existance of topic, mark topic as being deleted and discover brokers.

      This access to Zookeeper in addition to Kafka broker should be removed, for the following reasons:

      • The ACL to Zookeeper can be different than the ACL for Kafka brokers
      • The Zookeeper can be chrooted to handle multiple Kafka clusters, in this case the broker has a zookeeper.connect=zk_host:2181/chroot. Unfortunatly we use kafka.utils.ZkUtils to access Zookeeper and this lib don't support chroot.
      • It is one more config to setup, Kafka brokers aka `bootstrap.servers` should be enough.

      The Zookeeper dependency should be removed in favor of Kafka broker API for instance org.apache.kafka.clients.admin.AdminClient.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 1 day
                1d