voltron-evaluation
voltron-evaluation copied to clipboard
siddk
Voltron Evaluation: Diverse Evaluation Tasks for Robotic Representation Learning
Hey! I had a question about models on the grasping task: I have recently re-run the scripts for it and visualized the outputs because the metrics looked very noisy to...
Hi, thanks a lot for your incredible framework and open-sourced codes! I was wondering if you have any plans to disclose the evaluation framework for the "Language-Conditioned Imitation" task, namely,...
Firstly, thanks very much for open-sourcing your package code and evaluation harness! I'm having trouble running the example and wanted to check if I'm doing something wrong. I downloaded ARC...
Hello, how can I evaluate on Franka Kitchen simulation environments.
It's pretty inconvenient to have users manually download the various datasets (especially the bigger ones such as OCID-Ref and the Franka/Adroit Demonstrations); having a nice interface/hosting solution would be nice....
Once finalized, would be nice to treat this as a modular, general library akin to the main [Voltron Robotics](https://github.com/siddk/voltron-robotics) package. Would ideally be nice so that `pip` handled everything (all...
Once the Visuomotor Control & Intent Scoring tasks have been integrated properly, would be nice to consolidate the V-Evaluation Harness into a more general API that can be used for...
Check with Shikhar + co. around sharing the video examples from the [WHiRL website](https://human2robot.github.io/) - possibly get more examples. Then: - [ ] Upload videos to GDrive add simple `gdown`...
Currently, both the Franka Kitchen & Adroit Visuomotor Control Tasks are implemented on top of the [R3M evaluation code](https://github.com/facebookresearch/r3m/tree/eval/evaluation). While a fairly straightforward addition to that codebase, it would be...