adis98
adis98
Any update on how to run the model on local gpus?
> Could you point me to (or share) instructions on how to run the one_billion_wds using GPipe on multiple local GPUs? You can run it using the following command: trainer...
> > > Could you point me to (or share) instructions on how to run the one_billion_wds using GPipe on multiple local GPUs? > > > > > > You...
Were you able to find a solution to this?
Could you guys give some tips on how to profile with GPipe? I've created a model thats GPipe-compatible (uses 4 gpus at the moment). Any particular tools?
@jonathanasdf, could you help me with this?
@bignamehyp , if the above mentioned scenario is not possible....does lingvo support data-parallelism? i.e, running multiple minibatches in parallel and then aggregating their results? If yes, what are the command...
I had a similar issue with windows. Worked fine when I switched to Ubuntu.
Hey, were you able to resolve this issue? I'm facing the same problem.
Is there any other example using gpipe? If not, I think it should be easy enough to copy paste the necessary parts from that class and use it on another...