Uploaded image for project: 'Nuxeo Drive '
  1. Nuxeo Drive
  2. NXDRIVE-2510

Prevent segmentation faults in tests

    XMLWordPrintable

    Details

      Description

      Nodes are crashing on a regular basis:

      Fatal Python error: Segmentation fault
      
      Thread 0x0000000303e56000 (most recent call first):
        File "/.../socket.py", line 704 in readinto
        File "/.../http/client.py", line 268 in _read_status
        File "/.../http/client.py", line 307 in begin
        File "/.../http/client.py", line 1347 in getresponse
        File "/.../site-packages/sentry_sdk/integrations/stdlib.py", line 102 in getresponse
        File "/.../site-packages/urllib3/connectionpool.py", line 440 in _make_request
        File "/.../site-packages/urllib3/connectionpool.py", line 699 in urlopen
        File "/.../site-packages/requests/adapters.py", line 439 in send
        File "/.../site-packages/requests/sessions.py", line 655 in send
        File "/.../site-packages/requests/sessions.py", line 542 in request
        File "/.../site-packages/nuxeo/client.py", line 292 in request
        File "/.../site-packages/nuxeo/operations.py", line 197 in execute
        File "client/remote_client.py", line 200 in execute
        File "client/remote_client.py", line 650 in get_changes
        File "engine/watcher/remote_watcher.py", line 677 in _call_and_measure_gcs
        File "engine/watcher/remote_watcher.py", line 689 in _get_changes
        File "engine/watcher/remote_watcher.py", line 107 in scan_remote
        File "engine/activity.py", line 262 in func_wrapper
        File "engine/watcher/remote_watcher.py", line 621 in _handle_changes
        File "engine/watcher/remote_watcher.py", line 71 in _execute
        File "engine/workers.py", line 196 in run
      
      Thread 0x0000000302d48000 (most recent call first):
        File "/.../site-packages/execnet/gateway_base.py", line 400 in read
        File "/.../site-packages/execnet/gateway_base.py", line 432 in from_io
        File "/.../site-packages/execnet/gateway_base.py", line 967 in _thread_receiver
        File "/.../site-packages/execnet/gateway_base.py", line 220 in run
        File "/.../site-packages/execnet/gateway_base.py", line 285 in _perform_spawn
      
      Current thread 0x00000002008c0e00 (most recent call first):
        File "/Users/tiger-222/projects/nuxeo-drive/tests/conftest.py", line 116 in cleanup_attrs
        File "/.../site-packages/_pytest/fixtures.py", line 941 in _teardown_yield_fixture
        File "/.../site-packages/_pytest/fixtures.py", line 1027 in finish
        File "/.../site-packages/_pytest/runner.py", line 395 in _callfinalizers
        File "/.../site-packages/_pytest/runner.py", line 405 in _teardown_with_finalization
        File "/.../site-packages/_pytest/runner.py", line 387 in _pop_and_teardown
        File "/.../site-packages/_pytest/runner.py", line 427 in _teardown_towards
        File "/.../site-packages/_pytest/runner.py", line 419 in teardown_exact
        File "/.../site-packages/_pytest/runner.py", line 175 in pytest_runtest_teardown
        File "/.../site-packages/pluggy/callers.py", line 187 in _multicall
        File "/.../site-packages/pluggy/manager.py", line 84 in <lambda>
        File "/.../site-packages/pluggy/manager.py", line 93 in _hookexec
        File "/.../site-packages/pluggy/hooks.py", line 286 in __call__
        File "/.../site-packages/_pytest/runner.py", line 255 in <lambda>
        File "/.../site-packages/_pytest/runner.py", line 311 in from_call
        File "/.../site-packages/_pytest/runner.py", line 254 in call_runtest_hook
        File "/.../site-packages/_pytest/runner.py", line 215 in call_and_report
        File "/.../site-packages/_pytest/runner.py", line 127 in runtestprotocol
        File "/.../site-packages/_pytest/runner.py", line 109 in pytest_runtest_protocol
        File "/.../site-packages/pluggy/callers.py", line 187 in _multicall
        File "/.../site-packages/pluggy/manager.py", line 84 in <lambda>
        File "/.../site-packages/pluggy/manager.py", line 93 in _hookexec
        File "/.../site-packages/pluggy/hooks.py", line 286 in __call__
        File "/.../site-packages/xdist/remote.py", line 89 in run_one_test
        File "/.../site-packages/xdist/remote.py", line 72 in pytest_runtestloop
        File "/.../site-packages/pluggy/callers.py", line 187 in _multicall
        File "/.../site-packages/pluggy/manager.py", line 84 in <lambda>
        File "/.../site-packages/pluggy/manager.py", line 93 in _hookexec
        File "/.../site-packages/pluggy/hooks.py", line 286 in __call__
        File "/.../site-packages/_pytest/main.py", line 323 in _main
        File "/.../site-packages/_pytest/main.py", line 269 in wrap_session
        File "/.../site-packages/_pytest/main.py", line 316 in pytest_cmdline_main
        File "/.../site-packages/pluggy/callers.py", line 187 in _multicall
        File "/.../site-packages/pluggy/manager.py", line 84 in <lambda>
        File "/.../site-packages/pluggy/manager.py", line 93 in _hookexec
        File "/.../site-packages/pluggy/hooks.py", line 286 in __call__
        File "/.../site-packages/xdist/remote.py", line 239 in <module>
        File "/.../site-packages/execnet/gateway_base.py", line 1084 in executetask
        File "/.../site-packages/execnet/gateway_base.py", line 220 in run
        File "/.../site-packages/execnet/gateway_base.py", line 285 in _perform_spawn
        File "/.../site-packages/execnet/gateway_base.py", line 267 in integrate_as_primary_thread
        File "/.../site-packages/execnet/gateway_base.py", line 1060 in serve
        File "/.../site-packages/execnet/gateway_base.py", line 1554 in serve
        File "<string>", line 8 in <module>
        File "<string>", line 1 in <module>
      [gw7] node down: Not properly terminated
      
      replacing crashed worker gw7
      

      Crashes happen at several location, it is hard to find the root cause.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: