MotionBERT icon indicating copy to clipboard operation
MotionBERT copied to clipboard

Transfer learning using dataset with different keypoints

Open axelssons opened this issue 2 years ago • 1 comments

Thank you for the great work with MotionAGFormer!

I have an own dataset with a different set of keypoints compared to H36M, with additional keypoints on the toes. Note that this dataset is small compared to H36M. The goal is to use the pre-trained (on H36M) model and train/finetune it on my own dataset using transfer learning, getting it to output my custom set of keypoints. How would one go about freezing the convolutional base layers and replacing the final fully connected layer / head layer with new ones having random weights on which we train? I assume this is a good option to solve the problem.

Best regards, Jonathan

axelssons avatar Mar 19 '24 10:03 axelssons

My thoughts are the same as yours. Did your code run successfully?

1259666087 avatar Mar 26 '24 09:03 1259666087