dmmSJTU

May I ask which code you use to extract frames of FineAction? I use https://github.com/open-mmlab/mmaction2/blob/main/tools/data/build_rawframes.py to extract frames, but some videos cannot be extracted.

train2017_color

1

Hello, https://github.com/TencentARC/T2I-Adapter/blob/16bba674b472121d5a86e3ed6b935f91d516bc74/train_sketch.py#L231 How do you obtain the mask images of train2017_color? Are you using stuff_train2017_pixelmaps? Look forward for your reply.

About training

1

Hello ChongMou, May I ask why you use “accelerate launch train_sketch.py --pretrained_model_name_or_path stabilityai/stable-diffusion-xl-base-1.0 --output_dir experiments/adapter_sketch_xl --config configs/train/Adapter-XL-sketch.yaml --mixed_precision="fp16" --resolution=1024 --learning_rate=1e-5 --max_train_steps=60000 --train_batch_size=1 --gradient_accumulation_steps=4 --report_to="wandb" --seed=42 --num_train_epochs 100” for training and...

KeyError: 'torch.CudaTensor'

2

Hi，I met KeyError: 'torch.CudaTensor' when running "python3 WCT.py --cuda". That's why? Look forward for your reply.

hello, What is used for training loss in this paper?

pretrained model

7

Hello, I really appreciate your work. May I ask where can I download the pretrained model for vit on Imagenet?

mmaction

1

Why can't the print information be printed in the files of https://github.com/taoyang1122/adapt-image-models/tree/main/mmaction?