Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-30324

Blob Metadata extraction seems to be Synchronous

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: ADDONS_10.10, 2021.x, 11.x
    • Fix Version/s: None
    • Component/s: Target Platforms

      Description

      Following our tests on Asper on NCO. We discovered some issues with the GC blobs deletion seeĀ NXP-30323. This NXP-30323 will be handled by Florent. But it seems that the Meta extraction is Synchronous, In the case of Aspera / S3DirectUpload where the blob is stored in S3. It can cause performances issues / timeout.

      2021-04-08T09:15:11,483 DEBUG [Nuxeo-Work-asperaCompletion-6:transfer:b58b51d2-656c-41f0-b900-64772ac70fa7:file:/b58b51d2-656c-41f0-b900-64772ac70fa7/sp21Kassam/Photographer's Selects/RAW/Louise/Sp21_RN_React_Infinity_2_Louise_Matich_Photography_FK_0050.cr2:] [org.nuxeo.ecm.core.blob.ManagedBlob] java.nio.file.NoSuchFileException: /home/ubuntu/aspera/nuxeo-server-tomcat-10.10/tmp/nxbincache.4887331594423113220/8184338813658212816-0
      java.nio.file.NoSuchFileException: /home/ubuntu/aspera/nuxeo-server-tomcat-10.10/tmp/nxbincache.4887331594423113220/8184338813658212816-0
      	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:1.8.0_282]
      	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_282]
      	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:1.8.0_282]
      	at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55) ~[?:1.8.0_282]
      	at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144) ~[?:1.8.0_282]
      	at sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99) ~[?:1.8.0_282]
      	at java.nio.file.Files.readAttributes(Files.java:1737) ~[?:1.8.0_282]
      	at java.nio.file.Files.size(Files.java:2332) ~[?:1.8.0_282]
      	at org.nuxeo.ecm.blob.s3.S3BlobStore.readBlob(S3BlobStore.java:443) ~[nuxeo-core-binarymanager-s3-10.10-HF42.jar:?]
      	at org.nuxeo.ecm.core.blob.LocalBlobStore.copyBlobGeneric(LocalBlobStore.java:157) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.blob.LocalBlobStore.copyOrMoveBlob(LocalBlobStore.java:99) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.blob.CachingBlobStore.getStream(CachingBlobStore.java:215) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.blob.BlobStoreBlobProvider.getStream(BlobStoreBlobProvider.java:145) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.blob.BlobStoreBlobProvider.getStream(BlobStoreBlobProvider.java:133) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.blob.ManagedBlob.getStream(ManagedBlob.java:60) ~[nuxeo-core-api-10.10-HF44.jar:?]
      	at org.nuxeo.binary.metadata.internals.ExifToolProcessor.getTemporaryFile(ExifToolProcessor.java:265) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.ExifToolProcessor.readMetadata(ExifToolProcessor.java:130) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.ExifToolProcessor.readMetadata(ExifToolProcessor.java:150) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.BinaryMetadataServiceImpl.readMetadata(BinaryMetadataServiceImpl.java:70) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.BinaryMetadataServiceImpl.writeMetadata(BinaryMetadataServiceImpl.java:195) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.BinaryMetadataServiceImpl.writeMetadata(BinaryMetadataServiceImpl.java:170) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.binary.metadata.internals.listeners.BinaryMetadataSyncListener.handleEvent(BinaryMetadataSyncListener.java:56) ~[nuxeo-binary-metadata-10.10-HF21.jar:?]
      	at org.nuxeo.ecm.core.event.impl.EventServiceImpl.fireEvent(EventServiceImpl.java:242) ~[nuxeo-core-event-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.api.AbstractSession.notifyEvent(AbstractSession.java:270) ~[nuxeo-core-10.10-HF42.jar:?]
      	at org.nuxeo.ecm.core.api.AbstractSession.createDocument(AbstractSession.java:708) ~[nuxeo-core-10.10-HF42.jar:?]
      	at org.nuxeo.ecm.platform.filemanager.service.extension.AbstractFileImporter.createOrUpdate(AbstractFileImporter.java:267) ~[nuxeo-platform-filemanager-core-10.10-HF32.jar:?]
      	at org.nuxeo.ecm.platform.filemanager.service.FileManagerService.createOrUpdateDocument(FileManagerService.java:275) ~[nuxeo-platform-filemanager-core-10.10-HF32.jar:?]
      	at org.nuxeo.ecm.automation.core.operations.services.FileManagerImport.run(FileManagerImport.java:88) ~[nuxeo-automation-features-10.10-HF44.jar:?]
      	at sun.reflect.GeneratedMethodAccessor225.invoke(Unknown Source) ~[?:?]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_282]
      	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_282]
      	at org.nuxeo.ecm.automation.core.impl.InvokableMethod.doInvoke(InvokableMethod.java:174) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.InvokableMethod.invoke(InvokableMethod.java:179) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationChainCompiler$OperationMethod.invoke(OperationChainCompiler.java:151) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationChainCompiler$CompiledChainImpl.lambda$invoke$0(OperationChainCompiler.java:218) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.OperationContext.call(OperationContext.java:314) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.OperationContext.callWithChainParameters(OperationContext.java:279) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationChainCompiler$CompiledChainImpl.invoke(OperationChainCompiler.java:215) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationServiceImpl.run(OperationServiceImpl.java:115) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationServiceImpl.lambda$run$0(OperationServiceImpl.java:105) ~[nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.OperationContext.call(OperationContext.java:314) [nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.OperationContext.callWithChainParameters(OperationContext.java:279) [nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.core.impl.OperationServiceImpl.run(OperationServiceImpl.java:105) [nuxeo-automation-core-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.server.jaxrs.batch.BatchManagerComponent.execute(BatchManagerComponent.java:356) [nuxeo-automation-server-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.automation.server.jaxrs.batch.BatchManagerComponent.execute(BatchManagerComponent.java:325) [nuxeo-automation-server-10.10-HF44.jar:?]
      	at com.nuxeo.aspera.connector.service.AsperaCompleteWork.bmExecute(AsperaCompleteWork.java:201) [nuxeo-aspera-core-3.0.3-SNAPSHOT-PR-316.jar:?]
      	at com.nuxeo.aspera.connector.service.AsperaCompleteWork.work(AsperaCompleteWork.java:83) [nuxeo-aspera-core-3.0.3-SNAPSHOT-PR-316.jar:?]
      	at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransaction(AbstractWork.java:493) [nuxeo-core-event-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:383) [nuxeo-core-event-10.10-HF44.jar:?]
      	at org.nuxeo.ecm.core.work.WorkHolder.run(WorkHolder.java:57) [nuxeo-core-event-10.10-HF44.jar:?]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_282]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_282]
      	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
      

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: