VAR icon indicating copy to clipboard operation
VAR copied to clipboard

how to use this for inpaint?

Open WenmuZhou opened this issue 1 year ago • 7 comments

WenmuZhou avatar Apr 08 '24 10:04 WenmuZhou

hi @WenmuZhou I'm currently polishing up the training and zero-shot generalizing codes and they'll be ready in this week.

keyu-tian avatar Apr 08 '24 10:04 keyu-tian

The in/out-painting inference is done by teacher-forcing the tokens where we want to keep, and let the VAR transformer only generate the other tokens. For in/out-painting, no class condition will be used. For class-conditional editing, it is simply implemented as ``class-conditional'' in-painting.

keyu-tian avatar Apr 08 '24 10:04 keyu-tian

Looking forward to the release of inpaint demo

WenmuZhou avatar Apr 08 '24 12:04 WenmuZhou

I'm also interested in the inpaint demo. I wonder if it will be released soon.

kl2004 avatar Apr 30 '24 16:04 kl2004

The in/out-painting inference is done by teacher-forcing the tokens where we want to keep, and let the VAR transformer only generate the other tokens. For in/out-painting, no class condition will be used. For class-conditional editing, it is simply implemented as ``class-conditional'' in-painting.

Could you please provide a more detailed explanation of how teacher-forcing the tokens is implemented in your model? Thanks.

Iceage7 avatar Jun 06 '24 08:06 Iceage7

same questions. Have no progress now...

zijinY avatar Nov 22 '24 07:11 zijinY

The in/out-painting inference is done by teacher-forcing the tokens where we want to keep, and let the VAR transformer only generate the other tokens. For in/out-painting, no class condition will be used. For class-conditional editing, it is simply implemented as ``class-conditional'' in-painting.

Hello keyu-tian,

Any update regarding in/out-painting scripts?

RohollahHS avatar Dec 10 '24 18:12 RohollahHS