mlmodel initialized with pretrained checkpoint is much slower than without pretrained checkpoint, wondering why

[YingkunZhou]

the left one is initialized with pretrained checkpoint and right one is without

[YingkunZhou]

initialized with pretrained checkpoint

python toolbox.py --model efficientformerv2_l --ckpt weights/eformer_l_450.pth --coreml

initialized without pretrained checkpoint

python toolbox.py --model efficientformerv2_l  --coreml