esvit icon indicating copy to clipboard operation
esvit copied to clipboard

can't load swin-tiny checkpoint right

Open ywdong opened this issue 3 years ago • 1 comments

hi, I use the swin-transformer.py to load the swin-tiny model pretrained by imagenet1k. And the message is here: msg: _IncompatibleKeys(missing_keys=['layers.0.blocks.1.attn_mask', 'layers.1.blocks.1.attn_mask', 'layers.2.blocks.1.attn_mask', 'layers.2.blocks.3.attn_mask', 'layers.2.blocks.5.attn_mask', 'head.weight', 'head.bias'], unexpected_keys=['head.mlp.0.weight', 'head.mlp.0.bias', 'head.mlp.2.weight', 'head.mlp.2.bias', 'head.mlp.4.weight', 'head.mlp.4.bias', 'head.last_layer.weight_g', 'head.last_layer.weight_v']) why is there missing keys here?

ywdong avatar May 26 '22 08:05 ywdong

Hi,do you have ckpt and train logs , can you share with me ? I got an error ,when I download them.

sym0926 avatar Aug 14 '24 11:08 sym0926