ben-bay
ben-bay
Thank u @ymubarka
I hate to break this to you, but I am unable to reproduce this bug. I was able to run this locally and distributed (after adding a `description` section).
This is what I ran: ``` description: name: hi description: hi merlin: resources: workers: merge_posthoc_workers: args: -l INFO --concurrency 36 --prefetch-multiplier 1 -Ofair steps: [merge_posthoc] study: - name: setup description:...
@koning looks like you're right, this is a problem and is more reproducible.
This reminds me of an error-checking feature I added to Maestro that never made it into Merlin because of the incompatibility. It's [here](https://github.com/LLNL/maestrowf/pull/243). Basically it checked that yaml spec types...
@ymubarka is this now fixed?
@FrankD412 thanks for the note. I've tried adding dill as a celery serializer (see [this branch](https://github.com/LLNL/merlin/blob/bugfix/ben/serializer/merlin/celery.py)) to no avail. For some reason the same `_pass_detect_cycle` problem appears to be breaking...
@FrankD412 ping! Our best analysis is that we would need to switch to json serialization of tasks in order to accommodate this dynamically-assigned `_pass_detect_cycle` function. That's a pretty big refactor...
Right, I just meant hidden from the average command line user.