ModelsGenesis icon indicating copy to clipboard operation
ModelsGenesis copied to clipboard

something about cpu explosion

Open lichen14 opened this issue 4 years ago • 0 comments

hi, Giovanni, I just re-implemented the MG-2D on my dataset and met with some other bug for cpu explosion.

When I used MG for pre-training, I found that the utilization rate of the CPU would increase strangely, but the utilization rate of the GPU fluctuated greatly, and the buzzer of the machine PC would alarm soon. After several rounds of debugging, I found that it was this piece of code that caused the CPU utilization to sharply increase to 4000%+!!!! https://github.com/MrGiovanni/ModelsGenesis/blob/13932523d1754a3180301448f4bfd5274a1c9f41/pytorch/utils.py#L45 I don't know why, but after changing np.dot in function : nonlinear_transformation and related calculations to torch, the CPU utilization has returned to normal (200%+).

Maybe this is a special case in my machine, and it has no reference value. Thanks. :-)

lichen14 avatar Nov 12 '21 08:11 lichen14