PHALP icon indicating copy to clipboard operation
PHALP copied to clipboard

Use a more complex model such as SMPL-X for hands and feet capture

Open cga-cmu opened this issue 2 years ago • 1 comments

I get the message WARNING: You are using a SMPL model, with only 10 shape coefficients.

How do I use a more complex model such as SMPL-X, which does a better job on hands and feet?

Thanks Chris Atkeson

cga-cmu avatar Dec 20 '23 19:12 cga-cmu

Well PHALP used underlying HMR which does not predict hands and feet. I suppose you could train another model using MANO that does do hands and include coco whole body 2d keypoints model in your synthetic ground truth to re-train the HMR2 model to include foot keypoints.

I know they released HaMER (geopavlakos / hamer which does do the hands. Maybe you can combine this alongside with a re-trained HMR2 head with feet keypoints. If you manage to do this, lmk because I am interested in a fully body, accurate tracking as well.

smandava98 avatar Feb 19 '24 12:02 smandava98