ROMP icon indicating copy to clipboard operation
ROMP copied to clipboard

Inaccurate fitting on images

Open sparshgarg23 opened this issue 4 years ago • 2 comments

Hi,I tried your code on some images obtained from web-cam as well as some images from yoga-82 dataset(on which mediapipe) was trained. Since,the pose changes are extreme,it seems the model is not able to get a correct fit. Any reaons on why that is happening results of fitting romp download (1) download (2) download

original images yoga1

![douche](https://user-images.githubusercontent.co real_cap00 m/34626942/148653266-6fa10108-7b54-42b9-b6cc-8de280b8992e.jpg) ? I hope you can give me some insight into what can be done to improve the fitting ,should i tune the parameters in the config file?

sparshgarg23 avatar Jan 08 '22 17:01 sparshgarg23

Have you fine-tuned ROMP on yoga-82 dataset with 2D pose annotations? To get a more accurate fitting, we may need the assitance of 2D pose. Taking ROMP's output as initialization, iterative optimizing the results to fit the 2D pose annotations, which can be achieved via SMPLify

Arthur151 avatar Jan 09 '22 02:01 Arthur151

ok will look into it thanks,one last thing can I use the output of ROMP as an intialization for SMPL-X. Also,apart from SMPL-X,is there any other work that deals with capturing full body expressions that you're aware of

sparshgarg23 avatar Jan 09 '22 05:01 sparshgarg23

hello @sparshgarg23, how did you manage to make the mesh transparent ?

blibot avatar May 26 '23 20:05 blibot

@blibot I am not sure I understand.The color of the mesh is the same as used in SMPL-X.Because I didn't fine tune ROMP,that's why the fit isn't accurate and it looks as if you just overlaid the mesh on the image.

sparshgarg23 avatar May 26 '23 20:05 sparshgarg23

image in this first picture it looks like the mesh is a bit transparent. I was wondering if you changed the opacity in the code.

blibot avatar May 26 '23 20:05 blibot

i didn't do any change.

sparshgarg23 avatar May 26 '23 21:05 sparshgarg23

ok thanks. are you running Simple_ROMP or ROMP ?

blibot avatar May 26 '23 21:05 blibot

as of now i am not working on the project

sparshgarg23 avatar May 26 '23 21:05 sparshgarg23