Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-29358

Fix stream consumer latency

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 10.10
    • Fix Version/s: 10.10-HF30
    • Component/s: Streams

      Description

      In 10.10 the latency reported by ./stream.sh monitor or datadog can be wrong an higher that the real one.

      For instance, the reported latency is 5h48 instead of 1min41

      ## Log: bulk-status partitions: 4
      ### Group: bulk-status
      | partition |   lag | latencyMs | latency      |  posTimestamp | posDate                  | curDate                  |     pos |     end | posOffset | ?endOffset? | posKey                               |
      |       --- |  ---: |      ---: | ---:         |          ---: | ---:                     | ---:                     |    ---: |    ---: |      ---: |        ---: | ---                                  |
      |       All | 12911 |  20897282 | 05:48:17.282 | 1593676800114 | 2020-07-02T08:00:00.114Z | 2020-07-02T13:48:17.396Z | 7857837 | 7870748 |         4 |     7870724 | d6ad7d20-78cf-40c1-bf7b-077e0889c92b |
      |         0 | 12911 |    101725 | 00:01:41.725 | 1593697595671 | 2020-07-02T13:46:35.671Z | 2020-07-02T13:48:17.396Z | 7857813 | 7870724 |   7857813 |     7870724 | 5492167e-92cb-4e08-9c94-1b79f2a09859 |
      |         1 |     0 |         0 | NA           | 1593694800117 | 2020-07-02T13:00:00.117Z | 2020-07-02T13:48:17.396Z |       4 |       4 |         4 |           4 | e6540179-303e-437d-b3e6-4763255ad514 |
      |         2 |     0 |         0 | NA           | 1593691200089 | 2020-07-02T12:00:00.089Z | 2020-07-02T13:48:17.396Z |       8 |       8 |         8 |           8 | dfa6ce00-f46f-4778-8523-3b52de5b34ce |
      |         3 |     0 |         0 | NA           | 1593676800114 | 2020-07-02T08:00:00.114Z | 2020-07-02T13:48:17.396Z |      12 |      12 |        12 |          12 | d6ad7d20-78cf-40c1-bf7b-077e0889c92b |
      

      This pb don't affect 11.1 because the fix is part of NXP-28801:
      https://github.com/nuxeo/nuxeo/commit/e737da82dbd1a00591be5a6fa44f3d525c307911

      The latency should be taken only on partition without lag.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 3 hours
                  3h

                    PagerDuty

                    Error rendering 'com.pagerduty.jira-server-plugin:PagerDuty'. Please contact your Jira administrators.