bing-song

I saw the same problem, namely, ""runtimeerror: Cuda error: no kernal image is available for execution on the device" when I run run_pretrained_openfold.py. I am using Azure GPU and follows...

Since this problem is very common to many people, I would like to give my detailed investigation and hopefully it will help to fix the problem soon. I tested on...

@gahdritz Here is the prints that I added around line 53 for main branch  Here is the output (Not sure why END...

It is the same. Here is the code that includes more prints. I added prints on the matmul on line 38 also. That is fine. ![Screen Shot 2022-08-02 at 9...

@gahdritz Here is the fasta file for this test. >7s0c_A_unpacked_A TNLCPFGEVFNATRFASVYAWNRKRISNCVADYSVLYNSASFSTFKCYGVSPTKLNDLCFTNVYADSFVI RGDEVRQIAPGQTGKIADYNYKLPDDFTGCVIAWNSNNLDSKVGGNYNYLYRLFRKSNLKPFERDISTEI YQAGSTPCNGVEGFNCYFPLQSYGFQPTNGVGYQPYRVVVLSFE If you have a fasta file that you want me to try on my machine, let me...

After set CUDO_LAUCH_BLOCKING=1, I did not see more debug info in the output.  Here is the output. ![Screen Shot 2022-08-02 at 10...

@gahdritz I am thinking about to open a ssh for my Azure GPU server for you to debug. Do you think this will help?

@gahdritz Can you let me know how to give you the ssh login info?

@gahdritz Just tried. I checked out the openfold main branch and rebuild docker container and run the inference with the precomputed MSA alignment data. I have exact the same error.

@gahdritz , it is working well without docker. The predicted structure is good compared with the electron microscopy.