Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-30374

Aspera manage S3 transient prefix bucket

    XMLWordPrintable

    Details

    • Tags:
    • Sprint:
      nxApps 2021 Cycle 5

      Description

      Aspera transient bucket config template is ignoring the

      nuxeo.s3storage.transient.bucket_prefix

      property that may be defined in the nuxeo.conf file.

      The code of the addon is actually not taking into account any prefix that may be defined for the transient bucket.

      It results in the Aspera add-on not being able to find the blob and we get 404 error as follow:

      code}
      2021-07-13T20:58:50,853 ERROR [Nuxeo-Work-asperaCompletion-7:transfer:7d233f9a-5757-4621-8841-92ef00108ea0:file:/7d233f9a-5757-4621-8841-92ef00108ea0/fl
      ash-slide-2.jpg:] [com.nuxeo.aspera.connector.service.AsperaCompleteWork] Error processing transfer: 7d233f9a-5757-4621-8841-92ef00108ea0, file: com.nux
      eo.aspera.connector.api.FileInfo@6a1ea0e5[path=/7d233f9a-5757-4621-8841-92ef00108ea0/flash-slide-2.jpg,underFolder=false]
      com.amazonaws.services.s3.model.AmazonS3Exception: Not Found (Service: Amazon S3; Status Code: 404; Error Code: 404 Not Found; Request ID: KGXB90EEFGDCW
      4M5; S3 Extended Request ID: s6p4JzmHg6fLO4l5tEKHkfgwlvEBT/yxUcdOdZ+exm9jimgHsueqC6zHvwpw/wYgU60OpYQ5Dx4=; Proxy: null)
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1828) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1412) ~[aws-java-sdk-core-1.11.878.jar:?
      ]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1374) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1145) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:802) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:770) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:744) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:704) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:686) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:550) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:530) ~[aws-java-sdk-core-1.11.878.jar:?]
      at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5219) ~[aws-java-sdk-s3-1.11.878.jar:?]
      at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5165) ~[aws-java-sdk-s3-1.11.878.jar:?]
      at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1350) ~[aws-java-sdk-s3-1.11.878.jar:?]
      at com.amazonaws.services.s3.AmazonS3Client.getObjectMetadata(AmazonS3Client.java:1324) ~[aws-java-sdk-s3-1.11.878.jar:?]
              at org.nuxeo.ecm.core.storage.sql.S3DirectBatchHandler.completeUpload(S3DirectBatchHandler.java:296) ~[nuxeo-core-binarymanager-s3-10.10-HF48.ja
      r:?]
      at com.nuxeo.aspera.connector.service.AsperaCompleteWork.bmExecute(AsperaCompleteWork.java:193) ~[nuxeo-aspera-core-3.0.3-rc.20.jar:?]
      at com.nuxeo.aspera.connector.service.AsperaCompleteWork.work(AsperaCompleteWork.java:83) [nuxeo-aspera-core-3.0.3-rc.20.jar:?]
      at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransaction(AbstractWork.java:493) [nuxeo-core-event-10.10-HF44.jar:?]
      at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:383) [nuxeo-core-event-10.10-HF44.jar:?]
      at org.nuxeo.ecm.core.work.WorkHolder.run(WorkHolder.java:57) [nuxeo-core-event-10.10-HF44.jar:?]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_292]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_292]
      at java.lang.Thread.run(Thread.java:748) [?:1.8.0_292]
      

        Attachments

        1. Screen Shot 2021-07-13 at 3.55.23 PM.png
          247 kB
          Lisa McIntyre
        2. Screen Shot 2021-07-13 at 3.55.34 PM.png
          166 kB
          Lisa McIntyre
        3. server(7).log
          44 kB
          Lisa McIntyre

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: