Uploaded image for project: 'Nuxeo Platform'
  1. Nuxeo Platform
  2. NXP-13228

Drive: investigate on randomly failing IT tests under Windows due to MemoryError in test_synchronize_deep_folders

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 5.6.0-HF26, 5.8.0-HF01, 5.9.2-SNAPSHOT
    • Fix Version/s: 5.6.0-HF29, 5.8.0-HF04, 5.9.1
    • Component/s: Nuxeo Drive

      Description

      Some times this test generates a MemoryError, probably due to the recursive call of Synchronizer._delete_with_descendant_states, see http://qa.nuxeo.org/jenkins/view/Drive/job/IT-nuxeo-drive-master-windows/435/console

      2013-12-10 22:39:48,565 3000 1724 ERROR    nxdrive.synchronizer Failed to sync LastKnownState<local_folder=u'Nuxeo Drive', local_path=u'/Nuxeo Drive Test Workspace/0123456789', remote_name=u'0123456789', local_state=u'synchronized', remote_state=u'deleted', pair_state=u'remotely_deleted'>, blacklisting doc pair for 300 seconds
22:39:48 Traceback (most recent call last):
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 1120, in synchronize
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 657, in synchronize_one
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 863, in _synchronize_remotely_deleted
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 203, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 212, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\synchronizer.py", line 225, in _delete_with_descendant_states
22:39:48   File "nuxeo-drive-client\nxdrive\logging_config.py", line 70, in <lambda>
22:39:48   File "C:\Python27\lib\logging\__init__.py", line 1213, in log
22:39:48     self._log(level, msg, args, **kwargs)
22:39:48   File "C:\Python27\lib\logging\__init__.py", line 1268, in _log
22:39:48     self.handle(record)
22:39:48   File "C:\Python27\lib\logging\__init__.py", line 1278, in handle
22:39:48     self.callHandlers(record)
22:39:48   File "C:\Python27\lib\logging\__init__.py", line 1318, in callHandlers
22:39:48     hdlr.handle(record)
22:39:48   File "C:\Python27\lib\logging\__init__.py", line 749, in handle
22:39:48     self.emit(record)
22:39:48   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\plugins\logcapture.py", line 82, in emit
22:39:48     self.buffer.append(self.format(record))
22:39:48 MemoryError
22:39:49 2013-12-10 22:39:49,466 3000 1724 ERROR    nxdrive.commandline Error executing 'test': 
22:39:49 Traceback (most recent call last):
22:39:49   File "nuxeo-drive-client\nxdrive\commandline.py", line 331, in handle
22:39:49   File "nuxeo-drive-client\nxdrive\commandline.py", line 456, in test
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\core.py", line 291, in run
22:39:49     return TestProgram(*arg, **kw).success
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\core.py", line 118, in __init__
22:39:49     **extra_args)
22:39:49   File "C:\Python27\lib\unittest\main.py", line 95, in __init__
22:39:49     self.runTests()
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\core.py", line 197, in runTests
22:39:49     result = self.testRunner.run(self.test)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\core.py", line 61, in run
22:39:49     test(result)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 176, in __call__
22:39:49     return self.run(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\suite.py", line 223, in run
22:39:49     test(orig)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\case.py", line 45, in __call__
22:39:49     return self.run(*arg, **kwarg)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\case.py", line 138, in run
22:39:49     result.addError(self, err)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\proxy.py", line 128, in addError
22:39:49     formatted = plugins.formatError(self.test, err)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\plugins\manager.py", line 99, in __call__
22:39:49     return self.call(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\plugins\manager.py", line 141, in chain
22:39:49     result = meth(*arg, **kw)
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\plugins\logcapture.py", line 232, in formatError
22:39:49     test.capturedLogging = records = self.formatLogRecords()
22:39:49   File "D:\cygwin\home\Nuxeo\Python\Python27\site-packages\nose\plugins\logcapture.py", line 239, in formatLogRecords
22:39:49     return map(safe_str, self.handler.buffer)
22:39:49 MemoryError

        Attachments

          Issue Links

          depends on

          Bug - A problem which impairs or prevents the functions of the product. NXDRIVE-334 Drive: memory leak when running nosetests under Windows

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. NXP-13418 Drive: investigate on randomly failing IT builds under Windows due to timeout in test_synchronize_deep_folders

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: