Ziji Shi (Steven)

icon indicating a website link https://zijishi.xyz/

icon company National University of Singapore icon location Singapore icon location Ph.D. student at NUS. I build highly efficient systems for ML.

Results 1 issues of Ziji Shi (Steven)

Can we run data parallelism together with pipeline parallelism on GPU?

1 comment

Hi lingvo contributors, Thanks for the prompt response to my previous ticket on docker version. I want to run gpipe together with data parallelism on an 8x GPU server. I...