runtime icon indicating copy to clipboard operation
runtime copied to clipboard
verified publisher icon tensorflow

distributed runtime

Open powderluv opened this issue 5 years ago • 5 comments

There were some references to a distributed_runtime but looks like that folder wasn't open-sourced. Are there any plans to open source it ?

Thanks

powderluv avatar May 22 '20 00:05 powderluv

It's WIP and will be open sourced down the road when we are ready. Thanks for your interest.

mhong avatar May 22 '20 01:05 mhong

Awesome thanks. Do you know if it will allow for running on stacks like MPI or will it be limited to TCP/IP ?

powderluv avatar May 22 '20 01:05 powderluv

It’s not limited to TCP/IP in the sense that the communication protocol could be made pluggable in the distributed runtime.

byronyi avatar May 22 '20 02:05 byronyi

awesome thx. Looking forward to the opensource release.

powderluv avatar May 22 '20 04:05 powderluv

btw is this different from the PJRT distributed runtime at the XLA level ? https://github.com/tensorflow/tensorflow/tree/master/tensorflow/compiler/xla/pjrt

powderluv avatar Jun 23 '20 17:06 powderluv