[NXP-29358] Fix stream consumer latency - Nuxeo Issue Tracker

XML

Word

Printable

Details

Type: Bug
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 10.10
Fix Version/s: 10.10-HF30
Component/s: Streams

Tags:
Team:
PLATFORM
Sprint:
nxplatform #12
Story Points:
2

Description

In 10.10 the latency reported by ./stream.sh monitor or datadog can be wrong an higher that the real one.

For instance, the reported latency is 5h48 instead of 1min41

## Log: bulk-status partitions: 4
### Group: bulk-status
| partition |   lag | latencyMs | latency      |  posTimestamp | posDate                  | curDate                  |     pos |     end | posOffset | ?endOffset? | posKey                               |
|       --- |  ---: |      ---: | ---:         |          ---: | ---:                     | ---:                     |    ---: |    ---: |      ---: |        ---: | ---                                  |
|       All | 12911 |  20897282 | 05:48:17.282 | 1593676800114 | 2020-07-02T08:00:00.114Z | 2020-07-02T13:48:17.396Z | 7857837 | 7870748 |         4 |     7870724 | d6ad7d20-78cf-40c1-bf7b-077e0889c92b |
|         0 | 12911 |    101725 | 00:01:41.725 | 1593697595671 | 2020-07-02T13:46:35.671Z | 2020-07-02T13:48:17.396Z | 7857813 | 7870724 |   7857813 |     7870724 | 5492167e-92cb-4e08-9c94-1b79f2a09859 |
|         1 |     0 |         0 | NA           | 1593694800117 | 2020-07-02T13:00:00.117Z | 2020-07-02T13:48:17.396Z |       4 |       4 |         4 |           4 | e6540179-303e-437d-b3e6-4763255ad514 |
|         2 |     0 |         0 | NA           | 1593691200089 | 2020-07-02T12:00:00.089Z | 2020-07-02T13:48:17.396Z |       8 |       8 |         8 |           8 | dfa6ce00-f46f-4778-8523-3b52de5b34ce |
|         3 |     0 |         0 | NA           | 1593676800114 | 2020-07-02T08:00:00.114Z | 2020-07-02T13:48:17.396Z |      12 |      12 |        12 |          12 | d6ad7d20-78cf-40c1-bf7b-077e0889c92b |

This pb don't affect 11.1 because the fix is part of ~~NXP-28801~~:
https://github.com/nuxeo/nuxeo/commit/e737da82dbd1a00591be5a6fa44f3d525c307911

The latency should be taken only on partition without lag.