SM20sam

Google Drive scripts: incorrect iteration

2

Observe the structure of an entry in the dataset for a json file: https://huggingface.co/datasets/drive-bench/arena [ { "scene_token": "da41ecbc644b4915b84bb732e35ebf8c", "frame_token": "7e4c3282bc2a4402b5d1d6705f9eb844", "question_type": "robust_qas", "question": "What is the current type of corruption?:...

Run Inference Using Oryx

1

Hello, may you please provide inference script for Oryx or at least the version of transformers you are using? Receiving this error when attempting to run inference using Oryx: Value...

Request for Finetuning Code

1

In your paper, you mention in 4.2.3. Fine-Tuned VLM Models, "Regarding DriveLM [59], we further investigate how the model benefits from in-distribution fine-tuning in the following section". Are the fine...

Corruption JSON files solely have question_type": "robust_qas"

5

In https://huggingface.co/datasets/drive-bench/arena the json file corresponding to corruptions only have the question_type: robust_qas This is a serious issue as the eval.py expects these question types: self.results = { "perception": {...