Ahmad Mujtaba

Results 3 comments of Ahmad Mujtaba

@guanghui0607 , Can you try testing it with A100x8, each having 40GB? I think this gonna be work.

@learnuser1 , A single GPU with 16GB VRAM is sufficient for inference.