Vedansh Thakkar

Results 3 comments of Vedansh Thakkar

I am facing the same issue. I have 16GB GPUP memory and batch size=1

@ncomly-nvidia @pjannaty Understood, however, if I am optimizing a 32 bit model and using precision_mode='FP16' as one of the conversion parameters, my understanding is that the weights of the converted/optimized...