retiming icon indicating copy to clipboard operation
retiming copied to clipboard
verified publisher icon google

kp2uv model

Open BadourAlBahar opened this issue 4 years ago • 4 comments

Hi Erika,

Congratulations on the great work. Very impressive.

I am trying to use the kp2uv model but I get weird results. Please find attached the kp_im and uv_output.

Any ideas why I am getting this.

Thanks!

kp_im output_uv

BadourAlBahar avatar Sep 06 '21 21:09 BadourAlBahar

Hi, this result looks reasonable to me. The shape of the head is a bit strange, but our layered neural rendering model can correct for slight issues like that, so this output is sufficient for our use case. Is that what you meant by the result looks 'weird'?

erikalu avatar Sep 08 '21 14:09 erikalu

Hi Erika,

The “weird” part for me is the pink color. I thought it should look blue/green.

I was also wondering how you trained this model. What was the loss of the model?

BadourAlBahar avatar Sep 08 '21 15:09 BadourAlBahar

Oh the pink is just the body part ID. The RGB channels correspond to IUV, where I is an integer 1-25 ( *10 for visualization purposes).

The losses are the same as in the original DensePose paper (see section 3.1).

erikalu avatar Sep 09 '21 01:09 erikalu

Thank you for the information Erika. Can you share the code for training the kp2dp model?

BadourAlBahar avatar Sep 10 '21 01:09 BadourAlBahar