Yinggan Xu

Observation space missmatch in X-IRL dataset

1

Hi! @kevinzakka Thank you for opensourcing the environment and the expert dataset. However, I noticed that the state.json file in each trajectory has a observation space of (51,) for gripper....

Baseline environment returns wrong dimension

1

Hi! Thank you for open-sourcing the work. I'm running the baseline script with ` python starter/ppo_nature_cnn_vision_only.py --config config/rl/static/naive_baseline/thin.json`. However, the environment keeps returning shape `65728` after setting `add_last_action_input` to False....

As we have seen in gym/gymnasium, the interpretation of observation is given in sort of wiki. This can really help in interpreting the network behavior as well as adjusting the...

Cannot use local files for AutoModelForVision2Seq when using BLIP3

3

### System Info - `transformers` version: 4.43.3 - Platform: Linux-5.4.0-26-generic-x86_64-with-glibc2.27 - Python version: 3.10.4 - Huggingface_hub version: 0.24.3 - Safetensors version: 0.4.3 - Accelerate version: 0.33.0 - Accelerate config: -...

`control_robot.py` does not work with Windows

3

### System Info ```Shell - `lerobot` version: 0.1.0 - Platform: Windows-10-10.0.22631-SP0 - Python version: 3.10.15 - Huggingface_hub version: 0.26.2 - Dataset version: 3.1.0 - Numpy version: 1.26.3 - PyTorch version...

Mixing the prepared dataset on the fly?

6

### ⚠️ Please check that this feature request hasn't been suggested before. - [x] I searched previous [Ideas in Discussions](https://github.com/axolotl-ai-cloud/axolotl/discussions/categories/ideas) didn't find any similar feature requests. - [x] I searched...