texar icon indicating copy to clipboard operation
texar copied to clipboard
verified publisher icon asyml

Is there anyway to empty cache/memory after loading get-2 into our model?

Open fabrahman opened this issue 5 years ago • 0 comments

I wonder if there is any strategy to empty cache after loading (Restoring) gpt2 parameters into our model? I am getting OOM error for batch_size and I wonder how if there is anyway to get around that when using massive pre-trained models?

fabrahman avatar Feb 14 '20 19:02 fabrahman