Auto-PyTorch icon indicating copy to clipboard operation
Auto-PyTorch copied to clipboard

Dropout application

Open ArlindKadra opened this issue 4 years ago • 2 comments

I have a question regarding dropout and how it is applied. In the previous non-refactored version of AutoPyTorch there was a dropout_shape hyperparameter, which does not seem to be there anymore. Is now dropout applied with the same rate at every layer and if not, does it follow the network shape then ?

ArlindKadra avatar Apr 27 '21 07:04 ArlindKadra

Hey, as far as I can tell, dropout_shape was not a hyperparameter but a parameter that depended on the network shape in the master branch. Similarly, it has exactly the same application in 'refactor_development'. You can find it here and for reference, it is implemented using this

ravinkohli avatar Apr 29 '21 09:04 ravinkohli

This will also be fixed in #358

ravinkohli avatar Feb 10 '22 17:02 ravinkohli