PTI icon indicating copy to clipboard operation
PTI copied to clipboard

The more smile, the more black

Open tengshaofeng opened this issue 3 years ago • 5 comments

tbq_0a186d611d3e2493bfb35ec396390806_age tbq_1803151818-00006002_org_smile thanks for your great work. Did you find the phenomenon above?

tengshaofeng avatar Jul 06 '22 01:07 tengshaofeng

Thanks!

Yes, I have, I think it is connected to the fact that the above image is more "out of domain" compared to the second image. I found you need to add more "power" to the editing directions in order to edit OOD images.

This is also a finding from earlier papers, you can see it in our quantitative analysis.

PTI mitigates this pheromone but does not solve it completely

hope this helps

danielroich avatar Jul 06 '22 19:07 danielroich

@danielroich thanks for your reply patiently. Did you means that I should collect more images which covers the OOD images, and
learn the new directions on the images?

tengshaofeng avatar Jul 07 '22 01:07 tengshaofeng

Something like that, use the same edit directions, but add more "power" to the tuning be feeding it with few-shot fine-tuning instead of one-shot as the classic PTI does

danielroich avatar Oct 18 '22 08:10 danielroich

So when fine-tuning, should I fixed some layers?

tengshaofeng avatar Oct 18 '22 08:10 tengshaofeng

No Add more images Try using the multi_id_coach on several images of the same person

danielroich avatar Oct 18 '22 10:10 danielroich