Is the weight of VQGAN same as the Encoder-Decoder of Stable Diffusion?

Open 543877815 opened this issue 2 years ago • 1 comments

Thanks for your brilliant work!!! I have some questions for more details. Are the weights of "vqgan_cfw_00011.ckpt" the same as the weight of encoder-decoder on "v2-1_512-nonema-pruned.ckpt". If it is, have the fuse_layers on "vqgan_cfw_00011.ckpt" been initialized?

Jul 05 '23 04:07 543877815

Thanks for your brilliant work!!! I have some questions for more details. Are the weights of "vqgan_cfw_00011.ckpt" the same as the weight of encoder-decoder on "v2-1_512-nonema-pruned.ckpt". If it is, have the fuse_layers on "vqgan_cfw_00011.ckpt" been initialized?

My answer (may be wrong): The weights of VAE in "vqgan_cfw_00011.ckpt" are the same as that in "v2-1_512-nonema-pruned.ckpt". The fuse_layers on "vqgan_cfw_00011.ckpt" are the params after the second traning stage.

Jul 05 '23 06:07 cswry