saugatkandel
saugatkandel
Pytorch even supports complex numbers natively now, so it looks like a lot of operations could be simplified now. I will try this out as well.
In case someone is reading this, I had to change the Batchnorm code slightly to make it work properly. Here are my changes to get Batchnorm2d working (Batchnorm1d is similar)....
I was looking through Optimistix and saw that this issue was referring to my paper! :) During my PhD, I also spent quite a bit of time developing autodiff-based optimization...