killandy
Results
2
issues of
killandy
Hi, I have some trouble about the orthogonality training steps. I noticed that the orthogonality layer is actually a Keras Lambda layer which only do the simple operation of inputs....
Hi, I'm confused by the function neumann_hyperstep_preconditioner since I found two versions of it. One in the rnn/train.py computes the hessian_term as : `hessian_term = (counter.view(1, -1) @ d_train_loss_d_w.view(-1, 1)...