Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-21534

Fix csv importer async work error when transient file is deleted

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 8.10
    • Fix Version/s: 8.10-HF01, 9.1
    • Component/s: CSV Importer

      Description

      When invoking the csv importer through the org.nuxeo.ecm.csv.core.operation.CSVImportOperation, the async work randomly fails with the following error in server.log:

      14:27:21,042 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC0wNDBlNGI4Mi1hNjAwLTQxNzgtYWY5OC1jOTFkNDFmYmVhOWNfMA==/955e7892-7f8a-466b-8ec8-c262c0345003 (No such file or directory)
      14:29:18,023 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC0wZjZmMzU1NS1iMmJjLTRiMTMtOTBkOC05NjkxODgwNDU4ODZfMA==/9ad33a36-3519-457f-818f-bf8257787cdd (No such file or directory)
      14:31:04,707 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC1lMDdlZjJiZC0yYTBkLTRkYjEtOGYxZC0yN2Y4NjczZTcxNWJfMA==/d6e8db6e-cfe8-4992-9726-e787d0eb3166 (No such file or directory)
      14:46:04,209 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC00YWViYWMxNC05NTM5LTQ2OTgtYmRkNy05OTJiNjExYTIyMzVfMA==/edaa8fa6-5c8a-4417-b960-88d978ae31c4 (No such file or directory)
      14:46:12,060 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC00NjNlZGEzYS1iZWM1LTRhNGYtYmQ4Ny03Mjk3NWQ2M2FjOWNfMA==/393e9b2a-7244-4b6c-85fa-387fbdf2ff3d (No such file or directory)
      14:46:22,345 ERROR [CSVImporterWork] Line 0: Error while doing the import: /opt/nxdata/transientstores/default/YmF0Y2hJZC00MmY1N2MwNC1jMDBhLTQzYjQtYTFhNy02MDU2ZmFlYTEzOTVfMA==/2e18e912-7866-4774-98dd-34848532c900 (No such file or directory)
      14:47:25,695 WARN  [CSVImporterWork] java.io.FileNotFoundException: /opt/nxdata/transientstores/default/YmF0Y2hJZC01MWJjYTQwYy0xNDljLTRiMjEtOGI2MC1hNjdiYmY1YTk2NTdfMA==/7ee4c757-f0e5-4e37-a200-341b99a5bcd1 (No such file or directory)
      

      the full exception stack is:

      java.io.FileNotFoundException: /opt/nxdata/transientstores/default/YmF0Y2hJZC01MWJjYTQwYy0xNDljLTRiMjEtOGI2MC1hNjdiYmY1YTk2NTdfMA==/7ee4c757-f0e5-4e37-a200-341b99a5bcd1 (No such file or directory)
      	at java.io.FileInputStream.open0(Native Method)
      	at java.io.FileInputStream.open(FileInputStream.java:195)
      	at java.io.FileInputStream.<init>(FileInputStream.java:138)
      	at org.nuxeo.ecm.csv.core.CSVImporterWork.newReader(CSVImporterWork.java:292)
      	at org.nuxeo.ecm.csv.core.CSVImporterWork.work(CSVImporterWork.java:236)
      	at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransaction(AbstractWork.java:410)
      	at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransactionAndCheckExceptions(AbstractWork.java:371)
      	at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:332)
      	at org.nuxeo.ecm.core.work.WorkHolder.run(WorkHolder.java:57)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      

      Indeed, when uploading a csv file with the batch upload enpoint, the file is stored in a transient store and it happens that the file is GC after the work is scheduled but before it is run.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: