TransVCL icon indicating copy to clipboard operation
TransVCL copied to clipboard

About hyper-parameter settings

Open lyakaap opened this issue 3 years ago • 2 comments

Great work! And congratulations for the acceptance of AAAI!

I have a question about hyper-parameter settings for VTA benchmark results. Do you have any reproducible hyper-parameter sets for all VTA methods? I have tried to reproduce the result from https://github.com/alipay/VCSL#benchmark using ISC feature with the hyper-parameters which is borrowed from default argument parameters in VCSL codebase, but still failed.

lyakaap avatar Nov 30 '22 04:11 lyakaap

Thanks! For reproducing the results in VTA benchmarks, you might need to run https://github.com/alipay/VCSL/blob/main/scripts/test_video_vta_tune.sh, and obtain the best tuned hyper-parameters on VCSL_val set at first.

SifengHe avatar Dec 01 '22 04:12 SifengHe

Thanks for the answer! I found that some of the hyper-parameters don't exist in https://github.com/alipay/VCSL/blob/main/scripts/test_video_vta_tune.sh . Do you have any idea how to determine the search space of such parameters?

lyakaap avatar Dec 01 '22 05:12 lyakaap