Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-27022

File descriptors for deleted ChronicleQueue audit files need to be freed

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 9.10, 10.10
    • Fix Version/s: 9.10-HF31, 10.10-HF06, 11.1
    • Component/s: Streams
    • Release Notes Summary:
      Chronicle Queue resources are freed when not used any more.
    • Tags:
    • Backlog priority:
      550
    • Sprint:
      nxcore 11.1.6, nxcore 11.1.8 / 11.1.9
    • Story Points:
      3

      Description

      File descriptors for deleted CQ files will persist until Nuxeo process is stopped.

      To reproduce:

      • start Nuxeo 10.10 with the following conf options
      • run imports for 5-10 min
      • use `lsof +L1 | grep audit` to see (deleted) files
      • verify that these (deleted) files are no longer in lsof output when Nuxeo is stopped
      Nuxeo configuration
      nuxeo.stream.audit.enabled=true
      nuxeo.stream.work.enabled=false
      nuxeo.stream.chronicle.retention.duration=4m
      nuxeo.stream.work.log.config=work
      nuxeo.stream.audit.batch.threshold.ms=500
      nuxeo.stream.audit.batch.size=25
      nuxeo.stream.audit.log.config=audit
      nuxeo.stream.work.over.provisioning.factor=3
      
      Example lsof output
      harlan@harlan:~$ lsof +L1 | grep audit
      lsof: WARNING: can't stat() tracefs file system /sys/kernel/debug/tracing
            Output information may be incomplete.
      java      13384 harlan  676u   REG  253,1  1310720     0 12464079 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1717.cq4 (deleted)
      java      13384 harlan  678u   REG  253,1  5242880     0 12329531 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1714.cq4 (deleted)
      java      13384 harlan  714u   REG  253,1  1310720     0 12464078 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1714.cq4 (deleted)
      java      13384 harlan  715u   REG  253,1  5242880     0 12329526 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1959.cq4 (deleted)
      java      13384 harlan  724u   REG  253,1  5242880     0 12329530 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-2003.cq4 (deleted)
      java      13384 harlan  725u   REG  253,1  5242880     0 12329524 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1957.cq4 (deleted)
      java      13384 harlan  726u   REG  253,1  5242880     0 12329532 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1715.cq4 (deleted)
      java      13384 harlan  727u   REG  253,1  1310720     0 12464095 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1715.cq4 (deleted)
      java      13384 harlan  728u   REG  253,1  5242880     0 12329525 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1958.cq4 (deleted)
      java      13384 harlan  729u   REG  253,1  5242880     0 12329533 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1716.cq4 (deleted)
      java      13384 harlan  730u   REG  253,1  1310720     0 12464097 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1716.cq4 (deleted)
      java      13384 harlan  731u   REG  253,1  5242880     0 12329529 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-2002.cq4 (deleted)
      java      13384 harlan  732u   REG  253,1  5242880     0 12329527 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-2000.cq4 (deleted)
      java      13384 harlan  733u   REG  253,1  5242880     0 12329528 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-2001.cq4 (deleted)
      java      13384 harlan  734u   REG  253,1  5242880     0 12329534 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/P-00/20190314-1717.cq4 (deleted)
      java      13384 harlan  737u   REG  253,1  1310720     0 12464120 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1958.cq4 (deleted)
      java      13384 harlan  740u   REG  253,1  1310720     0 12463977 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1957.cq4 (deleted)
      java      13384 harlan  741u   REG  253,1  1310720     0 12464146 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-2000.cq4 (deleted)
      java      13384 harlan  745u   REG  253,1  1310720     0 12464132 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-2001.cq4 (deleted)
      java      13384 harlan  750u   REG  253,1  1310720     0 12464121 /home/harlan/nuxeo-server-10.10-tomcat/nxserver/data/stream/audit/audit/offset-AuditLogWriter/20190314-1959.cq4 (deleted)
      

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 1 day, 4 hours
                1d 4h

                  PagerDuty

                  Error rendering 'com.pagerduty.jira-server-plugin:PagerDuty'. Please contact your Jira administrators.