zaoyi comments

Repositories
Issues
Comments

Results 1 comments of


                                            zaoyi

Add documentation for running inference on multiple GPUs

Any updates? @better629 's workaround perfectly works for few times of prompt, but it finally fail for like 8 times of prompt. As far I can tell, the GPU RAM...