Minh-Hai Tran

Results 1 comments of Minh-Hai Tran

fix addcmul and add_ Try this: exp_avg_sq.mul_(beta2).addcmul(grad, grad, value = 1 - beta2) exp_avg.mul_(beta1).add_(grad, alpha = 1 - beta1 )