clearlyzero
clearlyzero
I also encountered a situation where the model was unable to converge. I kept the learning rate constant at 5e-5 and it seemed that it could not converge.
> > 我也遇到过模型无法收敛的情况。我将学习率保持在5e-5不变，看起来无法收敛。 > > 损失会在0.2左右波动 In my experiment, the loss is around 0.4. Can it be understood as convergence around 0.2?
> > > > 我也遇到过模型无法收敛的情况。我将学习率保持在5e-5不变，看起来无法收敛。 > > > > > > > > > 损失会在0.2左右波动 > > > > > > In my experiment, the loss is around 0.4. Can...
> > > > > > 我也遇到过模型无法收敛的情况。我将学习率保持在5e-5不变，看起来无法收敛。 > > > > > > > > > > > > > > > 损失会在0.2左右 > > > > > > >...
> > > > > > > > 我也遇到过模型无法收敛的情况。我将学习率保持在5e-5不变，看起来无法收敛。 > > > > > > > > > > > > > > > > > > > > >...
> > > > > > > > > > 我也遇到过模型无法收敛的情况。我将学习率保持在5e-5不变，看起来无法收敛。 > > > > > > > > > > > > > > > > > > >...
May I ask if the latent space size of the autokl encoder used in the LSUN_Churches data set is 32x32x4? I am currently using 64x64x3. I wonder if this is...
> > May I ask if the latent space size of the autokl encoder used in the LSUN_Churches data set is 32x32x4? I am currently using 64x64x3. I wonder if...
> @e4s2022 @shencuifeng While I'm training a KL-reg autoencoder, the KL loss is also increasing. However, after I change the pixel value range of images from [-1, 1] to [0,...
> @ryhhtn @GuHuangAI @e4s2022 @shencuifeng When I trained the autoencoder, I found the total loss is really huge, about 1e4 (this depends on the size of the reconstructed image, but...