Open-Sora icon indicating copy to clipboard operation
Open-Sora copied to clipboard
verified publisher icon hpcaitech

使用vqvae之后loss下降的非常缓慢，请问有参考的loss曲线吗？

Open jeffchy opened this issue 1 year ago • 2 comments

jeffchy avatar Mar 09 '24 06:03 jeffchy

We also found this. I guess the range of the output of VQVAE is not suitable to DiT model. We may need to normalize it.

ver217 avatar Mar 11 '24 09:03 ver217

OK, 那我等等

jeffchy avatar Mar 11 '24 11:03 jeffchy

We also find this and report here. As a result, we choose a VAE from stability-ai to train our current models.

zhengzangw avatar Mar 18 '24 05:03 zhengzangw