DIST_KD
DIST_KD copied to clipboard
hunto
Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
Dear hunto: Recently,I had reproduce your paper's method,which is based on DIST KD with Cityscapes Segmentation.But I got worse result. My experiment is as follows： The parameters is based on...
~/WCL/KD/DIST_KD-main/classification$ sh tools/dist_train.sh 1 configs/strategies/distill/dist_cifar.yaml ${cifar_resnet20} --teacher-model ${cifar_resnet56} --experiment ${checkpoint} --teacher-ckpt ${'./ckpt/ckpt_epoch_240.pth'} bash: ${'./ckpt/ckpt_epoch_240.pth'}: bad substitution 作者您好，我在跑cifar结果时，已经把ckpt文件下载好并指定路径，但出现如上bad substitution报错，请教作者解决方法，谢谢！
I trained a resnet34 teacher on my custom dataset with 9 classes. I arranged the dataset in the imagenet format. I modified the dataset/builder.py like this: # pre-configuration for the...
Greetings! I read your paper with great interest and am trying to reproduce some of your experiments. I want to reproduce your vanilla KD setting using strategy B1, B2, B3...
after changing my command to **python tools/train.py --dataset imagenet --data-path /home/malaika_m/DIST_KD/classification/data/imagenet/ --config configs/strategies/distill/dist_b2.yaml --model timm_tf_efficientnet_b0 --teacher-model timm_resnet50 --experiment EfficientNetB0-Resnet50-SB** I am getting the error after my first epoch, why it...
Hi, I read you TPAMI and the github link led me here. But when I checked the code I realized that this repo is for DIST and not DIST+. So,...
I am getting size error of an image when i do knowledge distillation from swin to resnet50. Did you use any kind of projection to do cross architectural knowledge distillation?