CuDNN error: CUDNN_STATUS_SUCCESS

[Midhilesh29]

Traceback (most recent call last):
  File "demo.py", line 56, in <module>
    demo(opt)
  File "demo.py", line 49, in demo
    ret = detector.run(image_name)
  File "/workspace/midhilesh/CenterNet/src/lib/detectors/base_detector.py", line 116, in run
    output, dets, forward_time = self.process(images, return_time=True)
  File "/workspace/midhilesh/CenterNet/src/lib/detectors/ctdet.py", line 30, in process
    output = self.model(images)[-1]
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/midhilesh/CenterNet/src/lib/models/networks/pose_dla_dcn.py", line 471, in forward
    x = self.base(x)
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/midhilesh/CenterNet/src/lib/models/networks/pose_dla_dcn.py", line 288, in forward
    x = self.base_layer(x)
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/container.py", line 91, in forward
    input = module(input)
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/conv.py", line 301, in forward
    self.padding, self.dilation, self.groups)
RuntimeError: CuDNN error: CUDNN_STATUS_SUCCESS

I got this error while using the demo file. Can anyone please help me with this problem?

I used Pytorch 0.4.1, CUDA 9.0.176

[xingyizhou]

It seems a pytorch installation issue. Can you make sure you can run other pytorch projects under this environment?

[wjgarnett]

have you sovled this problem???

[XavierYoungY]

Has anyone solved this problem?

[lhyfst]

I met this problem, too.

[liushuai839]

I met this problem, too. have you solve this problem?? It disturb me for 2days!!!

[xiaowk5516]

fobidden cudnn in code

`import torch

torch.backends.cudnn.enabled=False`

[lhyfst]

try a different batch size.

[sh7jacobi]

I have the same problem. Different batch size did not solve this problem

[sh7jacobi]

fobidden cudnn in code

`import torch

torch.backends.cudnn.enabled=False`

It helped me. I added this code to test,py at first

[GabrielGuez]

fobidden cudnn in code

`import torch

torch.backends.cudnn.enabled=False`

Should I do that even if the project is supposed to use cudnn ? I don't know if it makes sense...a bit lost ^^

[sh7jacobi]

@GabrielGuez, I think you can learn this model by setting torch.backends.cudnn.enabled=False. But I am not sure it will work correctly if you implement the model in another project, where it needs cudnn.

[GabrielGuez]

@sh7jacobi Thank you for your answer. After further investigation, it seems that torch.backends.cudnn.benchmark = True did the trick :) Apparently it 'optimizes' CuDNN somehow, don't really understand how thought. If someone have an idea how it works, don't hesitate to give a quick explanation. Have a good day.

[mahmoudEltaher]

@sh7jacobi Thank you for your answer. After further investigation, it seems that torch.backends.cudnn.benchmark = True did the trick :) Apparently it 'optimizes' CuDNN somehow, don't really understand how thought. If someone have an idea how it works, don't hesitate to give a quick explanation. Have a good day.

Thanks that is worked with me :)

[andrewtratz]

@sh7jacobi Thank you for your answer. After further investigation, it seems that torch.backends.cudnn.benchmark = True did the trick :) Apparently it 'optimizes' CuDNN somehow, don't really understand how thought. If someone have an idea how it works, don't hesitate to give a quick explanation. Have a good day.

Worked for me too

[Nishikanta059]

@sh7jacobi Thank you for your answer. After further investigation, it seems that torch.backends.cudnn.benchmark = True did the trick :) Apparently it 'optimizes' CuDNN somehow, don't really understand how thought. If someone have an idea how it works, don't hesitate to give a quick explanation. Have a good day.

its working ,means no errors but its using cpu instead of gpu .Can you suggest how to train it on gpu ?