unacceptable behavior on sphereface network settings

[ghost]

I tested your code for 20-layer setting of Sphereface paper with the CNN and residual units but the loss value for m=4 became weirdly huge.