Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-24037

LogStreamProcessor should handle multiple LogConfig

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 9.10
    • Fix Version/s: QualifiedToSchedule
    • Component/s: Streams
    • Tags:
    • Story Points:
      5

      Description

      In 9.10 the LogStreamProcessor run a topology of computations using a single LogManager.
      This means that all the computations share the same Log configuration.

      By supporting multiple LogManager we could:

      • have different LogConfig per computation, for Kafka, this means different Consumer and Producer options which is necessary if the computation have distinct throughput.
      • create a topology that mix computations using stream in Kafka and Chronicle, so we could get the best of both impl:
      • distribute load over a cluster using kafka
      • run locally multiple computations without network overhead and leverage chronicle speed

      LogStreamProcessor must be extended to take a list of LogManagers.

      LogManager must be extended to have a name.

      The association between a Stream and the LogManager can be done by extending the Settings.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: