torchdyn icon indicating copy to clipboard operation
torchdyn copied to clipboard

Integrate `functorch` or wait for `torch.vmap` in `PyTorch`

Open Zymrael opened this issue 4 years ago • 3 comments

Several methods and classes in torchdyn would benefit from vjp/jvp: LNN, MSForward and others. We should decide on a way to integrate the functional API of PyTorch and then merge into torchdyn the prototypes using the internal vmap API.

Zymrael avatar Jul 25 '21 08:07 Zymrael

Hi, I'm one of the authors of functorch. We now have binary builds of functorch (e.g. one can do pip install functorch) so including functorch as a dependency is much easier now :)

zou3519 avatar May 19 '22 21:05 zou3519

Great news @zou3519, we will begin integrating functorch in several torchdyn classes.

Zymrael avatar May 31 '22 16:05 Zymrael

Please let us know if you run into any problems (feel free to open issues over at https://github.com/pytorch/functorch), functorch is actively being developed and we'd be interested in helping support your use case.

zou3519 avatar May 31 '22 17:05 zou3519