ControlCap

ControlCap copied to clipboard

Problem: The demo/demo.yaml file contained an absolute path to the checkpoint file on the author's PC, like so: "/Workspace/ZhaoYuzhong/ControlCap/output/train/vg_refcocog_5e/20240316102/checkpoint_4.pth" Fix: The demo/demo.yaml file now contains a relative path to the...

Arqam-Siddiqi

您好！请问如果在运行bash /data/xsf/ControlCap/scripts/train/train_vg1.2.sh训练脚本后产生的权重文件假如是checkpoint_0.pth到checkpoint_4.pth。 请问有没有办法从checkpoint_4.pth接着训练然后产生checkpoint_5.pth呢？还是只能从头开始训练，得到checkpoint_0.pth到checkpoint_5.pth这样。

Xie-Shaofeng

evaluation

1

您好，我在运行测试脚本bash scripts/train **train_vg1.2.sh**后，得到权重文件output/train/vg1.2_5e/20250823190/**checkpoint_0.pth**，然后运行测试脚本bash scripts/eval/**eval_vg1.2_densecap.sh** output/train/vg1.2_5e/20250823190/checkpoint_0.pth输出了如下的结果： 2025-08-24 18:01:25,810 [INFO] load checkpoint from /root/autodl-tmp/ControlCap/ckpts/checkpoint_0.pth 2025-08-24 18:01:25,824 [INFO] Evaluating on val. 2025-08-24 18:01:25,825 [INFO] dataset_ratios not specified, datasets will be concatenated (map-style datasets)...

Xie-Shaofeng

The minimal computational resources?

3

Hi, there! Thanks for your nice work! I would like to know the minimal resources needed to train the overall pipeline of your model. I have 8 NVIDIA 3090 GPUs...

VoyageWang

environment

12

1）请问环境配置中有的包需要numpy大于2.0，而python==3.8只能安装numpy==1.24，请问可以升级到python==3.10吗？ 2）请问模型是不是需要A100才能配置运行，4090架构模型某些代码运行不了？

ghost

How to contruct the baseline of controlcap?

6

I tried to construct the baseline without using the control embedding by directly revising the code of Controlcap, the val map is 0.04.

liweiyangv

关于google/flan-t5-xl

1

嗨您好！ 在运行您代码的时候无法自动下载google/flan-t5-xl，需要手动下载，但是官网下面有很多文件不知道下载哪些（如图）  ，请问下载后应该放在代码目录的哪个位置呢，期待您的回复

ZSMZSM

可以提供权重的其他下载方式吗

3

您好，我这里登不了onedrive，请问能提供其他方式的权重下载吗，比如谷歌网盘或者百度网盘。

emmating12