yusijin02

Results 11 comments of yusijin02

Just change this line: ``` from diffusers.pipeline_utils import DiffusionPipeline ``` to: ``` try: from diffusers.pipeline_utils import DiffusionPipeline except: from diffusers.pipelines.pipeline_utils import DiffusionPipeline ```

https://github.com/hpcaitech/Open-Sora/blob/a37a189482a4cd1c7892aa06881e539cbf8078ce/configs/opensora/inference/16x256x256.py#L19-L23 改成 ``` text_encoder = dict( type="t5", from_pretrained="path/to/your/model", model_max_length=120, local_cache=True, ) ``` 注意,如果你的模型下载路径为`/home/xxx/model/t5-v1_1-xxl`, 在这里应该传入:`from_pretrained="/home/xxx/model"`

> > https://github.com/hpcaitech/Open-Sora/blob/a37a189482a4cd1c7892aa06881e539cbf8078ce/configs/opensora/inference/16x256x256.py#L19-L23 > > > > 改成 > > ``` > > text_encoder = dict( > > type="t5", > > from_pretrained="path/to/your/model", > > model_max_length=120, > > local_cache=True, > >...

跟着readme中的指引安装环境,特别是 ``` pip install -v . ```

> > 跟着readme中的引导安装环境,特别是 > > ``` > > pip install -v . > > ``` > > ![image](https://private-user-images.githubusercontent.com/142073348/318192825-af60e078-50d8-4e94-a076-7fef1675da62.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTE4NTQ5NjUsIm5iZiI6MTcxMTg1NDY2NSwicGF0aCI6Ii8xNDIwNzMzNDgvMzE4MTkyODI1LWFmNjBlMDc4LTUwZDgtNGU5NC1hMDc2LTdmZWYxNjc1ZGE2Mi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMzMxJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDMzMVQwMzExMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1mZWE4YTEyNmMxYzc2MGQwYzIxYTkyNzlhNmFmMDY3NjI3M2UzNDdhNjIzYjViMjE2ZTE1MDE1YTljZDA3OWU4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.Aw6AYg8ko7f0kkIe2lk4iEpxEovbhTCxupIlWbG_Mxw) 我在colab中配置环境运行demo.py出现以上错误,请问这个可以解决么? 你这个是显存炸了啊, 看截图最下面那行. 要么更换更大显存的GPU, 或改为多卡; 要么使用半精、降低bs等方法降低显存要求

我留意到`y_null`的引入: https://github.com/hpcaitech/Open-Sora/blob/a37a189482a4cd1c7892aa06881e539cbf8078ce/opensora/schedulers/iddpm/__init__.py#L69 但是在样本级别的拼接为什么会影响输出样本?

你能正确输出视频吗?我用16x256x256推理经过dit的这个forward函数: https://github.com/hpcaitech/Open-Sora/blob/a37a189482a4cd1c7892aa06881e539cbf8078ce/opensora/models/stdit/stdit.py#L215

> > 你能正确输出视频吗?我用16x256x256推理经过dit的这个forward函数: > > https://github.com/hpcaitech/Open-Sora/blob/a37a189482a4cd1c7892aa06881e539cbf8078ce/opensora/models/stdit/stdit.py#L215 > > 我也是16x256x256,能正常生成视频,但是不经过dit的forward函数,都不知道它是咋推理的 断点调试逐步进内层吧,能出视频肯定是有正常进forward了,只是不一定是你看的那个