Yu Chi, Lin comments

Repositories
Issues
Comments

Results 2 comments of


                                            Yu Chi, Lin

torch.cuda.DeferredCudaCallError: CUDA call failed lazily at initialization with error: 'NoneType' object is not iterable

@Justin-12138 Hi, did you solve that? I also encounter that issue with RTX4090 =(

torch.cuda.DeferredCudaCallError: CUDA call failed lazily at initialization with error: 'NoneType' object is not iterable

@Justin-12138 Thanks for the quick reply! I successfully converted it after setting envs using [PR2658](https://github.com/NVIDIA/TensorRT-LLM/issues/2658#issuecomment-2691113963) & upgrading NumPy. Sincere thanks!