Lukas Hermann

It could be a problem with the GPU renderer when you run the rollouts. Can you try turning off rollouts and see if it still crashes? You have to add...

ah sorry, my bad, then try only using `~callbacks/rollout_lh~. Is your Nvidia driver correctly installed? In the log you previously sent it mentions Mesa, which shouldn't be used if you...

I just realized there is a mistake in the README file, when `pytorch-lightning` upgraded to a newer version, they renamed the `trainer.gpus` argument to `trainer.devices`. This is already reflected in...

I suggest you increase the batch size, we used 8 NVIDIA RTX 2080 ti with only 12 GB of memory per GPU, so if you have A100, you can easily...

By default, it saves the model every epoch. If you didn't set the `log_dir` command line argument, then it creates a folder `runs` in the hulc directory, where all the...

in order to make the rollouts work, did you have a look at this [issue](https://github.com/mees/calvin/issues/59) ?

I guess you refer to "vis" and "lang". We use the `pytorch-lightning` `CombinedLoader` which combines two individual datasets. https://github.com/mees/calvin/blob/main/calvin_models/calvin_agent/datasets/calvin_data_module.py#L121C32-L121C46 Hulc builds upon Calvin and thus uses the Calvin dataloader and...

Because of `pybullet`, the easiest method is to run every environment in its own subprocess. For reinforcement learning, Stable Baselines 3 provides a SubprocessVecEnv wrapper for that, read this [guide](https://stable-baselines3.readthedocs.io/en/master/guide/vec_envs.html)....

I think the problem occurs when you convert the initial condition of a test sequence into the concrete object and scene positions in [this](https://github.com/mees/calvin/blob/main/calvin_models/calvin_agent/evaluation/evaluate_policy.py#L128) line. An initial condition is a...

If you want to quickly test block positions, I think it is easiest if you run `python calvin_env/calvin_env/envs/play_table_env.py scene=calvin_scene_C` and you edit the values in the scene config [here](https://github.com/mees/calvin_env/blob/main/conf/scene/calvin_scene_C.yaml#L42). By...