NOTE: This issue seems specific to the 2023 deployment, as the instance was already freezing at import before the recent fix https://jira.nuxeo.com/browse/NXP-32160 while the 2021 deployment was responsive.
—
When importing a distribution into the beta platform explorer (running on nuxeo 2023.4.5 with platform-explorer 2023.0.3): https://explorer.beta.nuxeocloud.com/
- The import is first done inside a tmp folder (a folderish nuxeo document).
- Then, a move to its final place is submitted to the BulkService.
- We await for that move to finish to delete the tmp folder.
- The timeout happens there (after 10 minutes).
When doing this in a local environment (docker image or zip), there is no timeout issue.
This is not exactly like the NCO environment which adds some extra bundles to the platform explorer beta.
In the end something seems to keep the BulkService busy, causing it to time out on the move operation.
server logs from the explorer beta are attached.
Here are a couple snippets that might be of interest:
2023-12-13T22:28:49,314 WARN [http-nio-0.0.0.0-8080-exec-4] [org.nuxeo.ecm.core.bulk.BulkServiceImpl] await timeout on BulkService, at least one uncompleted command: org.nuxeo.ecm.core.bulk.message.BulkStatus@41de2007[action=updateReadAcls,commandId=1d09744d-01b0-4e5e-94ee-d2c65a63c32c,completedTime=<null>,delta=false,errorCode=<null>,errorCount=0,errorMessage=<null>,processed=<null>,processingDurationMillis=<null>,processingEndTime=<null>,processingStartTime=<null>,queryLimitReached=false,result={},scrollEndTime=1702505352558,scrollStartTime=1702505352504,skipCount=<null>,state=RUNNING,submitTime=1702505352445,total=2486,username=system] 2023-12-13T22:28:49,325 ERROR [http-nio-0.0.0.0-8080-exec-4] [org.nuxeo.apidoc.snapshot.SnapshotManagerComponent] Failed importing NXDistribution: {nxdistribution:latestFT=false, nxdistribution:latestLTS=false, nxdistribution:aliases=next 2021.47.x, nxdistribution:hide=false} 2023-12-13T22:28:49,326 ERROR [http-nio-0.0.0.0-8080-exec-4] [org.nuxeo.apidoc.browse.Distribution] org.nuxeo.ecm.core.api.NuxeoException: NXDistribution import timed out after 10 minutes while waiting for asynchronous processing. org.nuxeo.ecm.core.api.NuxeoException: NXDistribution import timed out after 10 minutes while waiting for asynchronous processing. at org.nuxeo.apidoc.snapshot.SnapshotManagerComponent.importTmpSnapshot(SnapshotManagerComponent.java:371) ~[nuxeo-apidoc-core-2023.0.3.jar:?] at org.nuxeo.apidoc.snapshot.SnapshotManagerComponent.importSnapshot(SnapshotManagerComponent.java:317) ~[nuxeo-apidoc-core-2023.0.3.jar:?]
—
2023-12-13T22:09:11,404 WARN [http-nio-0.0.0.0-8080-exec-3] [Transaction] Unexpected exception from afterCompletion; continuing org.nuxeo.lib.stream.StreamRuntimeException: Unable to send record with key: 3a23aee2-da6d-4ee9-b230-2daf5132e779 on Name{id='work-pictureViewsGeneration', urn='work/pictureViewsGeneration'}-01`
—
2023-12-13T15:56:25,800 INFO [metrics-datadog-reporter-1-thread-1] [org.apache.http.impl.execchain.RetryExec] I/O exception (java.net.SocketException) caught when processing request to {s}->https://api.datadoghq.com:443: Connection or outbound has closed
- causes
-
NXBT-3793 Disable beta failure notifications in explorer pipelines
- Resolved