mPLUG-2 icon indicating copy to clipboard operation
mPLUG-2 copied to clipboard
verified publisher icon X-PLUG

Does the inference need to run on 8 A100?

Open simanw304 opened this issue 2 years ago • 1 comments

I tried to run inference for video captioning on 1 A100 but got OOM issues. Does the inference need to run on 8 A100 or can it run one one A100? Thanks in advance.

simanw304 avatar Aug 11 '23 00:08 simanw304

Hello @Roleone123 and @MAGAer13 Is it possible to do inference of mPLUG-2 model for video captioning on multiple GPUs?

rose-jinyang avatar Oct 16 '23 14:10 rose-jinyang