Tensor4D icon indicating copy to clipboard operation
Tensor4D copied to clipboard
verified publisher icon DSaurus

How much memory is needed to run this code?

Open RuoyiDu opened this issue 2 years ago • 1 comments

Excellent work! How much memory is needed to run this code (train and inference)?

RuoyiDu avatar Jun 05 '23 21:06 RuoyiDu

Hi @RuoyiDu,

It requires ~15GB of memory in most cases. You can also decrease batch_size or use fp16 mode to further reduce memory usage.

DSaurus avatar Jun 07 '23 20:06 DSaurus