Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-31302

Allow to configure the bucket prefix of the s3DirectUploadBlobProviderDestination BlobProvider

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2023.0, 2021.28
    • Component/s: BlobManager
    • Release Notes Summary:
      A new 'nuxeo.s3storage.s3DirectUpload.bucket_prefix' conf property is available to specify the bucket prefix of the blobProvider backing the transientStore used by the s3 batchHandler
    • Tags:
    • Team:
      PLATFORM
    • Sprint:
      nxplatform #72
    • Story Points:
      2

      Description

      The bucket_prefix property if s3DirectUploadBlobProviderDestination is not configurable:

      https://github.com/nuxeo/nuxeo-lts/blob/64f696213faffa96d1371d55e2fbad4123a38927/packages/nuxeo-amazon-s3-package/src/main/resources/install/templates/s3binaries/nxserver/config/s3directupload-config.xml.nxftl#L55

      This is an issue when using several different Nuxeo apps, each of them using their own S3 bucket prefix. Nuxeo presales use a shared bucket/region (to avoid reaching the max 100 buckets limit we have on this account).

      The fact that this BlobProvider is not configurable for the prefix leads to the following issue: A user uploads a file in demo #1, then the GC of Demo#2 cleans it up. So, the GC of demos#1 logs a 

      [org.nuxeo.ecm.core.blob.LocalBlobStore] Unknown blob for key: d7180165c77ad86d6df61e922a3513f7

      and after some weeks/months, we have dozens of lines filling the log.

      Notice https://jira.nuxeo.com/browse/NXP-30560 does not fix this, it fixes the issue for several providers of the same Nuxeo app)

        Attachments

          Issue Links

          causes

          Task - A task that needs to be done. NXP-31393 Fix typo in s3directupload-config.xml.nxftl template for s3 bucket prefix conf

          • Blocker - Blocks development and/or testing work, production could not run.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. NXP-31323 TransientStore GC throws "Not Started" Exception

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: