Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-31323

TransientStore GC throws "Not Started" Exception

    XMLWordPrintable

    Details

    • Release Notes Summary:
      Transient Store GC are no longer started if already in progress
    • Tags:
    • Team:
      PLATFORM
    • Sprint:
      nxplatform #73, nxplatform #74
    • Story Points:
      3

      Description

      We see very few errors like the following, even if there is no real issue (the next GC is working) this bug should be fixed.

      org.nuxeo.ecm.core.api.NuxeoException: Work failed after 0 retries, class=class org.nuxeo.ecm.core.transientstore.TransiantStorageGCWork id=automation category=transientStorageGC title=Transient Store GC on automation
	at org.nuxeo.ecm.core.work.AbstractWork.workFailed(AbstractWork.java:482) ~[nuxeo-core-event-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:400) ~[nuxeo-core-event-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.work.WorkHolder.run(WorkHolder.java:57) ~[nuxeo-core-event-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.work.WorkComputation.processRecord(WorkComputation.java:111) ~[nuxeo-core-event-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.lambda$processRecordWithRetry$10(ComputationRunner.java:514) ~[nuxeo-stream-2021.26.5.jar:?]
	at net.jodah.failsafe.Functions$10.call(Functions.java:252) [failsafe-1.1.0.jar:1.1.0]
	at net.jodah.failsafe.SyncFailsafe.call(SyncFailsafe.java:145) [failsafe-1.1.0.jar:1.1.0]
	at net.jodah.failsafe.SyncFailsafe.run(SyncFailsafe.java:81) [failsafe-1.1.0.jar:1.1.0]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.processRecordWithRetry(ComputationRunner.java:514) [nuxeo-stream-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.processRecordWithTracing(ComputationRunner.java:465) [nuxeo-stream-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.processRecord(ComputationRunner.java:457) [nuxeo-stream-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.processLoop(ComputationRunner.java:315) [nuxeo-stream-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.runOnce(ComputationRunner.java:259) [nuxeo-stream-2021.26.5.jar:?]
	at org.nuxeo.lib.stream.computation.log.ComputationRunner.run(ComputationRunner.java:226) [nuxeo-stream-2021.26.5.jar:?]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
	at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: org.nuxeo.ecm.core.api.NuxeoException: Not started
	at org.nuxeo.ecm.core.blob.LocalBlobStore$LocalBlobGarbageCollector.stop(LocalBlobStore.java:323) ~[nuxeo-core-api-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.blob.CachingBlobStore$CachingBinaryGarbageCollector.stop(CachingBlobStore.java:482) ~[nuxeo-core-api-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.transientstore.keyvalueblob.KeyValueBlobTransientStore.doGC(KeyValueBlobTransientStore.java:304) ~[nuxeo-core-cache-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.transientstore.TransientStorageComponent.doGC(TransientStorageComponent.java:107) ~[nuxeo-core-cache-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.transientstore.TransiantStorageGCWork.work(TransiantStorageGCWork.java:63) ~[nuxeo-core-cache-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransaction(AbstractWork.java:536) ~[nuxeo-core-event-2021.26.5.jar:?]
	at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:387) ~[nuxeo-core-event-2021.26.5.jar:?]
	... 17 more

      https://app.datadoghq.com/logs?cols=host%2Cservice&context_event=AYPWlKCNAABx8Rnd-Nz0twAA&event&from_ts=1663166977138&index=&live=true&messageDisplay=inline&query=%40thrown.message%3A%22Not+started%22+service%3Aaaa-540&stream_sort=time%2Cdesc&to_ts=1665758977138&viz=

        Attachments

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. NXP-30851 Improve KV TransientStore GC resiliency

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NXP-31302 Allow to configure the bucket prefix of the s3DirectUploadBlobProviderDestination BlobProvider

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: