-
Type: Improvement
-
Status: Resolved
-
Priority: Major
-
Resolution: Fixed
-
Affects Version/s: 2021.0, 2023.0
-
Component/s: Streams
-
Release Notes Summary:The Bulk Scroller is now using a slow consumer Kafka configuration
-
Tags:
-
Backlog priority:750
-
Team:PLATFORM
-
Sprint:nxplatform #118
-
Story Points:3
The bulk scroller is configured with a 48-hour timeout (nuxeo.core.bulk.scroller.transactionTimeout=2d) because we know that scrolling an entire repository can take a long time.
However the corresponding Kafka poll interval is using the default value (kafka.max.poll.interval.ms=7200000) which is common from all topics.
This ticket is to request a custom configuration for the scroller to use a dedicated Kafka configuration where the pool interval is configured to the same value as the transaction timeout.