MachineLearningNotebooks
MachineLearningNotebooks copied to clipboard
Submit child runs from a pipeline step
I would like to submit child runs from within a pipeline step. Specifically, the script in my PythonScriptStep has a for-loop to train a model with different parameters. I would like each step in the for-loop to be submitted to a node in my compute cluster. How can I do that? I am thinking I could use Run.submit_child() inside the for loop to spawn multiple jobs. Is there any guide on how to do so?