Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-14292 Provide an audit service based on Elasticsearch
  3. NXP-15089

Provide a migration system from Hibernate to ElasticSearch

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.0
    • Component/s: Audit, Elasticsearch
    • Upgrade notes:
      Hide

      When nuxeo-elasticsearch-audit is deployed it will automatically replace the default JPA implementation.

      However, if you have previous data inside JPA you have to migrate it.

      The migration is done in a Worker that will simply go through all existing JPA Audit entries to store them inside the Elasticsearch index.

      The migration is done using a configurable batch size (default is 1000 entries).

      An Automation Operation is provided to trigger the migration Work.

      Sample call using curl :

      curl -H 'Content-Type:application/json+nxrequest' -X POST -d '{"params":{"batchSize":5000}}' -u Administrator:Administrator http://nuxeoserver:8080/nuxeo/api/v1/automation/Audit.StartMigration

      NB : Migration of 16 Millions entries on a C3.XLarge AWS instance with default PGSQL setup and default embedded Elasticsearch takes about 2h30 (1800 entries/s).

      Show
      When nuxeo-elasticsearch-audit is deployed it will automatically replace the default JPA implementation. However, if you have previous data inside JPA you have to migrate it. The migration is done in a Worker that will simply go through all existing JPA Audit entries to store them inside the Elasticsearch index. The migration is done using a configurable batch size (default is 1000 entries). An Automation Operation is provided to trigger the migration Work. Sample call using curl : curl -H 'Content-Type:application/json+nxrequest' -X POST -d '{"params":{"batchSize":5000}}' -u Administrator:Administrator http://nuxeoserver:8080/nuxeo/api/v1/automation/Audit.StartMigration NB : Migration of 16 Millions entries on a C3.XLarge AWS instance with default PGSQL setup and default embedded Elasticsearch takes about 2h30 (1800 entries/s).

      Description

      When deploying the new nuxeo-audit-elasticsearch plugin, we should be able to migrate the existing audit entries from Hibernate to ElasticSearch.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: