torchx icon indicating copy to clipboard operation
torchx copied to clipboard

significance of flags described in the dist.py in ray context

Open atinsood opened this issue 3 years ago • 1 comments

❓ Questions and Help

Question

We are trying to run torchx with ray as the scheduler and trying to understand the significance of some. of the flags and whether those flags are valid in ray scheduler setup

  1. https://github.com/pytorch/torchx/blob/main/torchx/components/dist.py#L173 is the image flag valid in ray setup

  2. similar with port mapping https://github.com/pytorch/torchx/blob/main/torchx/components/dist.py#L179 . does this has any significance in ray setup.

atinsood avatar Jul 11 '22 15:07 atinsood

  1. Image field maps to the directory it runs in though under normal usage it is overridden by the TempDirWorkspace which is build from the local files https://github.com/pytorch/torchx/blob/8c0345c297c24409f8d6ea5f5231bddd4a8d538f/torchx/workspace/dir_workspace.py#L19-L31
  2. port_maps are mostly informative and aren't passed to Ray as there doesn't seem to be a way to do so https://github.com/pytorch/torchx/blob/main/torchx/schedulers/ray_scheduler.py#L308

d4l3k avatar Jul 12 '22 22:07 d4l3k