pyPESTO icon indicating copy to clipboard operation
pyPESTO copied to clipboard

Deadlock caused by going out of memory with MultiProcessEngine

Open plakrisenko opened this issue 2 years ago • 0 comments

Bug description When running optimizations for a large-scale model (encountered with Fröhlich et al. 2018, 143 control conditions) with MultiProcessEngine if memory isn't sufficient some processes get killed without any notification. This causes a deadlock and task execution never finishes.

Expected behavior It would be nice if a sudden death of a process lead to termination of entire pool, ideally with informative error message.

Environment

  • Operating system: Ubuntu 22.04 & Rocky Linux release 8.7 (Green Obsidian)
  • pypesto version: 0.3.1
  • Python version: 3.10

plakrisenko avatar Aug 22 '23 11:08 plakrisenko