AVT

AVT copied to clipboard

Hi, Do we have annotations for 50Salads? Thanks!

CeeZh

Hi there, thanks so much for the interesting work! I'm a bit confused on how to reproduce the precise attention map visualizations in the AVT paper, showing which frames attend...

vineetparikh

Traceback (most recent call last): File "train_net.py", line 44, in main() # pylint: disable=no-value-for-parameter # Uses hydra File "lib/python3.7/site-packages/hydra/main.py", line 95, in decorated_main config_name=config_name, File "lib/python3.7/site-packages/hydra/_internal/utils.py", line 401, in _run_hydra...

htcboy

Hi, Rohit! May I ask if I can replace [the model definition using the package 'transformers'](https://github.com/facebookresearch/AVT/blob/b082c99a6b3104780237022274db74f5c3124cc5/models/future_prediction.py#L89) with any other package or code? That would solve my following issue. The 'transformers'...

coolbay

-l seems to go into deadlock

7

Hi, I'm able to train models with `-g`, but when I try to train on my local machine with multiple GPUs with `-l`, the model doesn't start training after the...

haofengac

EK55 primary meric report

2

Hi @rohitgirdhar! In the following table, the recall@5 metric reported is the many-shot version?  Thanks!

ofir1080

The input/output feature dimensions of Transformer Encoder and Causal Transformer Decoder?

1

Hi, thanks for your great project! I am wondering the input/output feature dimensions of Transformer Encoder. The description in Section 4.1 of the paper shows the input/output feature dimensions are...

yxgz

Generate submitted file

3

We can only see the accuracy of validation set, when we run `` python launch.py -c expts/02_ek100_avt_tsn.txt -l -t``. Can you tell us how to generate the submitted file for...

interestingzhuo

Long-term anticipation

1

Hi, thanks for repo! Excuse me, could you please tell how to perform long-term anticipation as showed in the paper? Have I missed this part in code, or it's not...

RodinIvan

Cannot train/test with video data

8

How can I train/test with video data? When I run `python launch.py -c expts/09_ek55_avt.txt -t -g`, I obtain the warning "No video_clips present": ``` [2022-02-08 17:15:53,778][func.train][INFO] - Computing clips... [2022-02-08...

CodyQ3