lazyTextPredict icon indicating copy to clipboard operation
lazyTextPredict copied to clipboard
verified publisher icon lemay-ai

fix CUDA memory issue for multiple runs

Open jiteshpabla opened this issue 5 years ago • 2 comments

Running the code more than once leads to CUDA out of memory issues. Fix that

jiteshpabla avatar Oct 05 '20 15:10 jiteshpabla

Used this link from the huggingface discussion to solve the issue.

jiteshpabla avatar Nov 16 '20 07:11 jiteshpabla

If the execution is stopped mid-training, then the GPU memory stays occupied. At that point, a manual memory clean in required (for eg. restart runtime in Google colab)

jiteshpabla avatar Nov 16 '20 08:11 jiteshpabla