HAF
HAF copied to clipboard
why do you use F.normalize() twice?
https://github.com/07Agarg/HAF/blob/fb29e3655db2419fd914e7d90cafc9e7b27e6a9d/util/arch/custom_resnet18.py#L497
https://github.com/07Agarg/HAF/blob/fb29e3655db2419fd914e7d90cafc9e7b27e6a9d/util/arch/custom_resnet18.py#L542
-
classifier_1_weight = F.normalize(self.classifier_1[0].weight, p=2, dim=1) -
classifier_1_weight = F.normalize(classifier_1_weight, p=2, dim=1)
I think it is not necessary there, twice