-
Type:
Task
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Won't Fix
-
Affects Version/s: None
-
Fix Version/s: NoFixVersionApplicable
-
Component/s: Model, Remote watcher
-
Epic Link:
When performing a remote scan of a large volume of documents, the duration of the SQLite DB insertions seem to increase along with the number of documents.
This is visible when launching VolumeTestCase.test_remote_scan by setting the TEST_REMOTE_SCAN_VOLUME environment variable to <docCount>, activating the TRACE logs and looking at:
TRACE nxdrive.engine.watcher.remote_watcher Local processing of descendants of Nuxeo Drive Test Workspace (defaultSyncRootFolderItemFactory#default#1a7520cc-dd2f-45ff-9b52-03cbb201f888) took 606 ms
Profiling RemoteWatcher._scan_remote_scroll shows that most of the time is spent in:
_find_remote_child_match_or_create (70 %)
--> insert_remote_state (47 %)
--> commit (49 %)
Attached profiling stats of a test with 1000 documents.
- depends on
-
NXDRIVE-1921 Add the capability to monitor tests
-
- Open
-
-
NXDRIVE-441
Test improved Remote Scan execution with volume
-
- Resolved
-
- is related to
-
NXDRIVE-1888 Improve database queries to anihile any deadlock
-
- Resolved
-
