cnahmgx

Results 4 comments of


                                            cnahmgx

CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!

有人遇到过这种问题么

import flash_attn rotary fail

帮忙看看呢

请问如何让程序并行执行，用到多GPU卡

@ybshaw 问题解决了么？

[BUG] <title> 多卡推理报错 RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:3!

@Etpoem 代码共享一下呢，搞了一天了，搞不定