Language-Modeling-GatedCNN icon indicating copy to clipboard operation
Language-Modeling-GatedCNN copied to clipboard

Could you please provide the log for training with the default configuration?

Open Jar7 opened this issue 8 years ago • 3 comments

I train the model with the provided dataset and configuration. And the initial loss is huge, e.g. 8~9e+10. I think there is something wrong with my training. Could you please provide the log for training. Thank you!

Jar7 avatar Jun 26 '17 07:06 Jar7

Me too, have you found any solution? @Jar7

sonack avatar Sep 18 '18 15:09 sonack

I have the same problem loss exaggerate to 4389657512261976064.00 rapidly.

dabney777 avatar Sep 25 '18 08:09 dabney777

Use Adam optimizer will get a lower loss but still higher than normal

dabney777 avatar Oct 05 '18 08:10 dabney777