-
Type:
Bug
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: 2023.3, 2021.46
-
Fix Version/s: None
-
Component/s: CI/CD
-
Team:PLATFORM
-
Sprint:nxplatform #107, nxplatform #108, nxplatform #110, nxplatform #111
-
Story Points:5
Launching the benchmark multiple times against Nuxeo 2023 shows some random failures on these test class:
- Sim20CreateDocuments (frequent)
- Sim10MassStreamImport (seen once).
Like here for Sim20CreateDocuments:
https://jenkins.platform.dev.nuxeo.com/blue/organizations/jenkins/nuxeo%2Flts%2Fnuxeo-benchmark/detail/nuxeo-benchmark/455/pipeline/
And here for Sim10MassStreamImport:
https://jenkins.platform.dev.nuxeo.com/blue/organizations/jenkins/nuxeo%2Flts%2Fnuxeo-benchmark/detail/nuxeo-benchmark/435/pipeline
Here the oldest random I found on Nuxeo 2021 (maybe some older, just stopped here):
https://jenkins.platform.dev.nuxeo.com/blue/organizations/jenkins/nuxeo%2Flts%2Fnuxeo-benchmark/detail/nuxeo-benchmark/408/pipeline
The following snippet of Sim20CreateDocuments varies from fail to fail (total number of docs, total treated, total elapsed time)
[2023-12-18T22:34:51.475Z] XXX number of documents: 87434 ... [2023-12-18T22:35:11.219Z] ================================================================================ [2023-12-18T22:35:11.219Z] 2023-12-18 22:35:11 19s elapsed [2023-12-18T22:35:11.219Z] ---- Requests ------------------------------------------------------------------ [2023-12-18T22:35:11.219Z] > Global (OK=17622 KO=0 ) [2023-12-18T22:35:11.219Z] > Create File (OK=17622 KO=0 ) [2023-12-18T22:35:11.219Z] [2023-12-18T22:35:11.219Z] ---- CreateDocuments ----------------------------------------------------------- [2023-12-18T22:35:11.219Z] [--------------------------------------------------------------------------] 0% [2023-12-18T22:35:11.219Z] waiting: 0 / active: 32 / done: 0 [2023-12-18T22:35:11.219Z] ================================================================================ [2023-12-18T22:35:11.219Z] [2023-12-18T22:35:11.219Z] Simulation org.nuxeo.cap.bench.Sim20CreateDocuments completed in 19 seconds [2023-12-18T22:35:11.219Z] 22:35:11.217 [main] ERROR io.gatling.app.Gatling$ - Run crashed [2023-12-18T22:35:11.480Z] java.lang.IllegalStateException: Feeder crashed: j.u.NoSuchElementException: None.get [2023-12-18T22:35:11.480Z] at io.gatling.core.action.SingletonFeed$$anonfun$receive$1.applyOrElse(SingletonFeed.scala:67) ~[gatling-core-3.3.1.jar:3.3.1] [2023-12-18T22:35:11.480Z] at akka.actor.Actor.aroundReceive(Actor.scala:539) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.actor.Actor.aroundReceive$(Actor.scala:537) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at io.gatling.core.akka.BaseActor.aroundReceive(BaseActor.scala:25) ~[gatling-core-3.3.1.jar:3.3.1] [2023-12-18T22:35:11.480Z] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:612) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.actor.ActorCell.invoke(ActorCell.scala:581) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.run(Mailbox.scala:229) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.exec(Mailbox.scala:241) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) ~[akka-actor_2.12-2.5.26.jar:2.5.26] [2023-12-18T22:35:11.480Z] java.lang.reflect.InvocationTargetException [2023-12-18T22:35:11.480Z] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [2023-12-18T22:35:11.480Z] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) [2023-12-18T22:35:11.480Z] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [2023-12-18T22:35:11.480Z] at java.base/java.lang.reflect.Method.invoke(Method.java:568) [2023-12-18T22:35:11.480Z] at io.gatling.mojo.MainWithArgsInFile.runMain(MainWithArgsInFile.java:53) [2023-12-18T22:35:11.480Z] at io.gatling.mojo.MainWithArgsInFile.main(MainWithArgsInFile.java:34) [2023-12-18T22:35:11.480Z] Caused by: java.lang.IllegalStateException: Feeder crashed: j.u.NoSuchElementException: None.get [2023-12-18T22:35:11.480Z] at io.gatling.core.action.SingletonFeed$$anonfun$receive$1.applyOrElse(SingletonFeed.scala:67) [2023-12-18T22:35:11.480Z] at akka.actor.Actor.aroundReceive(Actor.scala:539) [2023-12-18T22:35:11.480Z] at akka.actor.Actor.aroundReceive$(Actor.scala:537) [2023-12-18T22:35:11.480Z] at io.gatling.core.akka.BaseActor.aroundReceive(BaseActor.scala:25) [2023-12-18T22:35:11.480Z] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:612) [2023-12-18T22:35:11.480Z] at akka.actor.ActorCell.invoke(ActorCell.scala:581) [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268) [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.run(Mailbox.scala:229) [2023-12-18T22:35:11.480Z] at akka.dispatch.Mailbox.exec(Mailbox.scala:241) [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [2023-12-18T22:35:11.480Z] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
