SMAC3 icon indicating copy to clipboard operation
SMAC3 copied to clipboard

Make pynisher + parallelization work

Open benjamc opened this issue 2 years ago • 0 comments

Pynisher and dask parallelization does not work together.

       Just a note, I've had no issues running pynisher inside of a subprocess running on a dask worker. This is likely not the issue. However there is some odd interplay between a `Nanny` worker class and a default `Worker` due to the fact the `Nanny` is in charge of rebooting failed workers. I don't really have more in depth info than that

Originally posted by @eddiebergman in https://github.com/automl/SMAC3/issues/1023#issuecomment-1578497837

If we get it to work, revert #1023.

benjamc avatar Jun 06 '23 12:06 benjamc