kinetics-i3d icon indicating copy to clipboard operation
kinetics-i3d copied to clipboard

flow_imagenet checkpoint

Open nik123 opened this issue 5 years ago • 0 comments

The readme states:

The default model has been pre-trained on ImageNet and then Kinetics

As far as I understand, "pre-trained on ImageNet" means 3D convolutional NN which weights are recieved by bootsrapping values from 2D convolutional NN trained on ImageNet. So data/checkpoints/rgb_imagenet checkpoint is RGB network which is initialized with bootstrapped weights from 2D NN (which was trained on RGB images from ImageNet) and then trained on Kinetics dataset. Please, correct me if there are any mistakes.

If the description above is correct then I'm not sure I understand how data/checkpoints/flow_imagenet weights were achieved. I think it is Flow network which is initialized with bootstrapped weights from 2D NN (which was trained on RGB images from ImageNet) and then trained on optical flow values from Kinetics dataset. It's suprising that flow NN is initialized with RGB values. Is it really so?

nik123 avatar May 16 '20 13:05 nik123