Open-Sora icon indicating copy to clipboard operation
Open-Sora copied to clipboard

Mismatch in last layers during inference

Open Trinita21typeset opened this issue 1 year ago • 2 comments

I am running the inference and this is what I am getting. The command that I ran: python sample.py -m "DiT-XL/2" --text "a person is walking on the street" --ckpt /home/nlp/open_sora/Open-Sora/pretrained_models/DiT-XL-2-256x256.pt --height 256 --width 256 --fps 10 --sec 5 --disable-cfg I downloaded the checkpoints using download.py in the given repo.

image

Trinita21typeset avatar Mar 06 '24 12:03 Trinita21typeset

Hi, as we modified the modeling, you cannot load pretrained DiT weights directly

ver217 avatar Mar 07 '24 09:03 ver217

Then can you let me know how to load the weights or where do I download the weights so that I can run the model locally?

Trinita21typeset avatar Mar 07 '24 20:03 Trinita21typeset

We have updated our code and inference. Please see here for more instructions.

zhengzangw avatar Mar 18 '24 05:03 zhengzangw