Zygmunt Łenyk

icon indicating an email [email protected]

icon company Microsoft icon location London, UK icon location Computer Vision, Deep Learning, Self-driving cars

Results 4 issues of Zygmunt Łenyk

LARS initialization is different than pytorch Optimizer in documentation

Thanks for creating this repo! It helps me a lot during training. I wanted to ask/suggest if it was possible the change the initialization of the optimizer to be consistent...

Question on the last transition layer

Hi! Thank you for publishing this. I'm following pytorch implementation of DenseNet, specifically I'm using densenet161 for extracting features from images. I'm wondering, in your implementation here, why after the...

Training not stable at the beginning

1 comment

Hi! Did you also experience very unstable training for the first ~100k training steps? Accuracy jumps from 0 to 80%, loss goes up or down around 40. This seem to...

Config for fine-tuning on Mini COCO

Hi! Could you provide config that you used to fine-tune pretrained model on Mini COCO? Paper mentions that there are some minor changes to model structure and a few things...