Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-19283

Possible race condition on Elasticsearch indexing command

    XMLWordPrintable

    Details

    • Epic Link:
    • Tags:
    • Upgrade notes:
      Hide

      There is nothing to do when upgrading to 8.3. To enable optimistic concurrency control in 6.0 or 7.10 you need to override the Elasticsearch config (elasticsearch-config.xml.nxftl to add a property {{ useExternalVersion="true" }} to the elasticSearchRemote or elasticSearchLocal tag.

      Show
      There is nothing to do when upgrading to 8.3. To enable optimistic concurrency control in 6.0 or 7.10 you need to override the Elasticsearch config ( elasticsearch-config.xml.nxftl to add a property {{ useExternalVersion="true" }} to the elasticSearchRemote or elasticSearchLocal tag.
    • Sprint:
      nxBD 8.2.1, nxBD 8.2.2, nxBD 8.4.5
    • Story Points:
      2

      Description

      Two concurrent indexing commands of the same document with different version data can be indexed in a wrong order.
      In this case the older version of a document overwrites the newer version.

      This happens when there is a particular sequence:

      • T1: save a document in v1, trigger an async indexation
      • I1: indexation thread load the document v1 and build its json representation
      • T2: save the document in v2, trigger an async indexation
      • I2: indexation thread load the document v2 and build its json representation
      • I2: submit the indexing command to ES with v2
      • I1: submit the indexing command to ES with v1 overriding v2

      To prevent this wrong ordering of concurrent indexing, we should have an optimistic concurrency control based on indexing command time.

        Attachments

          Issue Links

          depends on

          New Feature - A new feature of the product, which has yet to be developed. NXP-19435 Internal change token for optimistic locking

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NXP-19422 UnrestrictedSessionRunner should not behave differently in Unit Test

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. NXP-19157 ITSearchTabTest#testSearch randomly failing

          • Major - Major loss of function.
          • Resolved
          is required by

          Bug - A problem which impairs or prevents the functions of the product. NXP-16169 Fix random unit test failure TestAutomaticIndexing.shouldIndexBinaryFulltext

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. NXP-24567 Elasticsearch indexing command that fails on optimistic concurrency should not log error

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. NXDOC-1007 create installation notes for 7.10-HF19 related to NXP-19283 and NXP-21326

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. NXDOC-1008 create installation notes for 6.0HF34 related to NXP-19283 and NXP-21326

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. NXDOC-1021 create installation notes for 6.0-HF34 related to NXP-19283 and NXP-21326

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. NXP-21326 Update Elasticsearch configuration for UT in 6.0 and 7.10 to use external version

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 0 minutes
                  0m
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 6 hours, 30 minutes
                  6h 30m