Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-25587

Enable to configure elastic index in translog async to reduce disk IO

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 9.10
    • Fix Version/s: 10.3
    • Component/s: Elasticsearch

      Description

      The elastic translog configuration can be set to request (default) or async.

      The default translog mode request generates lots of disk IO on elastic nodes.

      Before 5.6 this setting was configurable at server level now it needs to be explicitly set at index setting level.

      The translog is already configurable for the nuxeo repository index using:
      elasticsearch.index.translog.durability=async

      But this is not the case for the 2 others indexes: audit and uid.
      This explains why elasticsearch disks are heavily stressed on mass audit write operation.

      The optimization elasticsearch.index.translog.durability=async should apply to all Nuxeo indexes (nuxeo, audit and uid).

      This async option should not be activated by default.

      Note that translog can be changed anytime using curl:

      curl -H "Content-Type: application/json" -XPUT "http://localhost:9200/nuxeo-uidgen/_settings" -d '{
        "index.translog.durability" : "async"
      }'
      
      curl -H "Content-Type: application/json" -XPUT "http://localhost:9200/nuxeo-audit/_settings" -d '{
        "index.translog.durability" : "async"
      }'
      

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 2 hours
                  2h