Samir Yitzhak Gadre

## Habitat-Sim version Habitat-Sim 0.2.2 ## 🐛 Bug As per this [README](https://github.com/facebookresearch/habitat-sim/blob/main/DATASETS.md#habitat-matterport-3d-research-dataset-hm3d), I am running the following command to retrieve `hm3d_minival`, which should come with semantic annotations: `python -m habitat_sim.utils.datasets_download...

## Problem The THOR medatada for agent pose and objects seems to live in the native Unity left-handed coordinate system. This might be confusing for people who are not familiar...

import errors

5

Hi all, thanks for the code release! I followed to instructions for installing dependencies via `requirements_static.txt`. I then tried `from language_table.environments.oracles import push_oracle_rrt_slowdown` and got the following error: ``` Traceback...

Thanks for releasing the dataset! I was wondering if it would be possible to also release the GT pybullet state information and a script to play-back a dataset trajectory. Thanks...

Often we may have special control tokens that need to be handle when creating the inputs and targets. To allow max flexibility, users should be able to provide their own...

It would be nice to simplify the checkpoint loading. Right now it is a bit confusing with `checkpoint_path`, `args.checkpoint_path`, `join(.., "checkpoints")`, `remote-sync`, etc. all referenced in various places in`main.py`

changing precision from `fp32` to `amp_bf16` leads to `pytest tests/test_grad_accum.py` failing ``` FAILED tests/test_grad_accum.py::test_grad_acc - AssertionError: Failed gradient checks at: ['tok_embeddings.weight', 'layers.0.attention.in_proj.weight', 'layers.0... FAILED tests/test_grad_accum.py::test_grad_acc_fsdp - torch.multiprocessing.spawn.ProcessRaisedException: ```

Currently when both options specified only the local storage is cleared of old checkpoints

Fused RMSNorm

2

Adding triton kernel for rms norm and testing