-
Type:
Bug
-
Status: Open
-
Priority:
Minor
-
Resolution: Unresolved
-
Affects Version/s: 2021.0
-
Component/s: S3
-
Tags:
-
Backlog priority:800
-
Sprint:nxplatform #112
-
Story Points:5
When uploading a 1TB+ document to S3, a timeout can occur as the result of both digest computation and S3 move occupying the vast majority of the process - even after setting a large timeout and setting nuxeo.core.blobstore.digestAsync=true.
computeAndReplaceDigest comprises the three following main steps:
- digest = computeDigest(blobStore); - calculating the md5 digest of the binary after downloading the blob to the filesystem.
- newKey = blobStore.copyOrMoveBlob(digest, blobStore, key, false); - S3 move wherein object key is set to the calculated digest in step 1.
- replaceDigestAllRepositories(); - DB operation to update all respective documents with the calculated digest.
For very large Documents, steps 1 and 2 taking a long time can cause the transaction to time out during step 3 where the following error can be observed. This should be prevented by having steps 1 and/or 2 performed in a separate transaction :
Caused by: org.nuxeo.runtime.transaction.TransactionRuntimeException: Transaction has timed out: Tx started: 1710245843373, timeout: 1710263843373 (duration 18000s), current: 1710268574364 at org.nuxeo.runtime.transaction.TransactionHelper.checkTransactionTimeout(TransactionHelper.java:277) ~[nuxeo-runtime-jtajca-2021.36.9.jar:?] at org.nuxeo.ecm.core.repository.RepositoryService.getSession(RepositoryService.java:301) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.local.LocalSession.getSession(LocalSession.java:65) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.AbstractSession.queryAndFetch(AbstractSession.java:1365) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.AbstractSession.queryAndFetch(AbstractSession.java:1345) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.replaceDigest(ComputeDigestHelper.java:157) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.lambda$replaceDigest$0(ComputeDigestHelper.java:145) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.CoreInstance$3.run(CoreInstance.java:268) ~[nuxeo-core-api-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.UnrestrictedSessionRunner.runUnrestricted(UnrestrictedSessionRunner.java:123) ~[nuxeo-core-api-2021.47.4.jar:?] at org.nuxeo.ecm.core.api.CoreInstance.doPrivileged(CoreInstance.java:270) ~[nuxeo-core-api-2021.47.4.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.lambda$replaceDigest$1(ComputeDigestHelper.java:145) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.runtime.transaction.TransactionHelper.lambda$runInTransaction$4(TransactionHelper.java:642) ~[nuxeo-runtime-jtajca-2021.36.9.jar:?] at org.nuxeo.runtime.transaction.TransactionHelper.runInTransaction(TransactionHelper.java:675) ~[nuxeo-runtime-jtajca-2021.36.9.jar:?] at org.nuxeo.runtime.transaction.TransactionHelper.runInTransaction(TransactionHelper.java:642) ~[nuxeo-runtime-jtajca-2021.36.9.jar:?] at org.nuxeo.runtime.transaction.TransactionHelper.runInTransaction(TransactionHelper.java:630) ~[nuxeo-runtime-jtajca-2021.36.9.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.replaceDigest(ComputeDigestHelper.java:144) ~[nuxeo-core-2021.47.4.jar:?] at java.util.ArrayList.forEach(ArrayList.java:1541) ~[?:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.replaceDigestAllRepositories(ComputeDigestHelper.java:139) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestHelper.computeAndReplaceDigest(ComputeDigestHelper.java:94) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.blob.ComputeDigestWork.work(ComputeDigestWork.java:55) ~[nuxeo-core-2021.47.4.jar:?] at org.nuxeo.ecm.core.work.AbstractWork.runWorkWithTransaction(AbstractWork.java:524) ~[nuxeo-core-event-2021.45.8.jar:?] at org.nuxeo.ecm.core.work.AbstractWork.run(AbstractWork.java:387) ~[nuxeo-core-event-2021.45.8.jar:?] ... 17 more