PiCANet-Implementation icon indicating copy to clipboard operation
PiCANet-Implementation copied to clipboard

The loss curve does not fall

Open luoshuifeiyang opened this issue 5 years ago • 1 comments

I didn't change the network, but the loss didn't fall. I thought the lr was too big or small ,but even I set it bigger or smaller, the loss curve always not fall. the model didn't converge。 Could you please tell me the reason? Thanks a lot.

luoshuifeiyang avatar Aug 16 '20 01:08 luoshuifeiyang

  1. If you train the network from the pretrained one, it would be possible that the loss didn't fall.
  2. If you train the network from random initialization, please check your data in/out is correct (same name image file in each images / masks folder).

image

This is my loss graph (from random initialization), and you can see that loss does not look converging about the first 10,000 steps. In my opinion, please wait for the model to converge, and please look carefully if the saliency prediction masks seem reasonable or not. If the masks do not seem reasonable, please attach the image of your saliency mask and loss graph to let me help you more.

Ugness avatar Aug 16 '20 06:08 Ugness