Aishwarya Padmakumar comments

Results 21 comments of


                                            Aishwarya Padmakumar

ProcTHOR support and speed

Thanks this helps!

Documentation of all `controller.step` operations and inverse of `raycast`

Thanks a lot!

The same action prediction gets different evaluation metrics in different runs

Hi, can you share the inference and `pred_actions` files generated for that particular EDH instance in the two runs. I need those to debug issues with metrics calculation. Also I...

The same action prediction gets different evaluation metrics in different runs

Hi @594zyc apologies for the delay in response. After taking a look at your inference files, I think this behaviour is likely caused by a bug we also found internally...

Evaluating Episodic Transformer baselines for EDH instances gives zero successes

Hi, While we do get some variance in our performance I don't think I have ever got a success rate of 0. Could you upload the saved metrics file somewhere...

Evaluating Episodic Transformer baselines for EDH instances gives zero successes

Hi @dv-fenix , I've noticed a few things from your command and metrics file. First of all, I have a feeling that 50 processes is too much for most machines...

Evaluating Episodic Transformer baselines for EDH instances gives zero successes

Hi @dv-fenix In addition to using fewer processes, I recommend pulling the latest version of the code. There was a small bug that would result in non-Docker inference erroring out...

Evaluating Episodic Transformer baselines for EDH instances gives zero successes

Hi @dv-fenix Just wanted to elaborate on the above response. It's hard to be entirely sure but I think you have run into a thorny issue with AI2-THOR that we...

Implementations of the rule-based TATC baseline

Hi, The TATC code needs further internal review before we are able to release it, and this could take some time. I will keep this issue updated with the status...

Different vocab size between `data.vocab` and `embs_ann`?

Hi @yingShen-ys, any idea whether such discrepancy exists in the following cases: - If you train a new model using our code - In pretrained models from the [original E.T....