GetDavid

root cause： no __init__.py file under shardformer folder.

10

root cause： no __init__.py file under shardformer folder. _Originally posted by @BountyMage in https://github.com/hpcaitech/Open-Sora/issues/232#issuecomment-2024569674_ 我有同样的错误，我加了init一样报错`/home/zdw/Open-Sora/opensora/acceleration/shardformer/__init__.py` ```python (opensora) zdw@ai-gpu-server149:~/Open-Sora$ torchrun --nnodes=1 --nproc_per_node=1 scripts/train.py configs/opensora/train/16x512x512.py --data-path /home/zdw/Open-Sora/pre_datasets/datasets1/datasets1.csv /data/share8/zdw/miniconda3/envs/opensora/lib/python3.10/site-packages/colossalai/pipeline/schedule/_utils.py:19: UserWarning: torch.utils._pytree._register_pytree_node is deprecated....

You are using a model of type llava to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.

5

我下载了```liuhaotian/llava-v1.6-34b```, 然后将```caption_llava.py```里对应路径改成本地路径,然后执行一下命令 ```bash (cuda118) zdw@ai-gpu-server149:~/cuda118/Open-Sora$ CUDA_VISIBLE_DEVICES=0,1 python -m tools.caption.caption_llava /home/zdw/video_datasets/clips output.csv Dataset contains 26 videos. Processing 26 new videos. Prompt: A video is given by providing three frames in chronological...

https://github.com/hpcaitech/Open-Sora/blob/main/assets/demo/sample_16s_224x448.gif