RepDistiller icon indicating copy to clipboard operation
RepDistiller copied to clipboard

about using the resnet models for cifar10

Open EmnaGuermazi97 opened this issue 3 years ago • 1 comments

Hello Sir, I would like to start by saying how great this work is! And I would like to know if the resnet models can be used directly on cifar10 instead of cifar100 or if there is some modification I should make? I tried using KD (logits) to make resnet32 learn from resnet110 but unfortunately, the accuracy I get is pretty bad: Acc= 43.35 after 250 epochs, a=0.1, b= 0.9 with no modification in the resnet models nor in function adjust_learning_rate.

EmnaGuermazi97 avatar Apr 18 '22 12:04 EmnaGuermazi97

Hi, were you able to get good accuracy after modifications?

ShristiDasBiswas avatar Mar 27 '24 19:03 ShristiDasBiswas