DriveLM icon indicating copy to clipboard operation
DriveLM copied to clipboard
verified publisher icon OpenDriveLab

Can you provide more information about DriveLM-CARLA?

Open hutchinsonian opened this issue 1 year ago • 2 comments

How to get answers to the questions in the full graph of DriveLM-CARLA？

hutchinsonian avatar Mar 02 '24 09:03 hutchinsonian

Hi, thanks for your interest in our work. Do you mean how we get the ground truth answers?

We collect data in CARLA with a privileged rule-based algorithm. During the data collection, we save privileged information from the simulator and information from the rule-based algorithm about the "triggered" rules for the current decision. So we have a range of metadata about perception-related things and decision-related things. With this metadata, we constructed a set of heuristics to create questions and answers for DriveLM-CARLA.

Let me know if this answers your question :) Best, Katrin

RenzKa avatar Mar 02 '24 14:03 RenzKa

Hi, thanks for your interest in our work. Do you mean how we get the ground truth answers?

We collect data in CARLA with a privileged rule-based algorithm. During the data collection, we save privileged information from the simulator and information from the rule-based algorithm about the "triggered" rules for the current decision. So we have a range of metadata about perception-related things and decision-related things. With this metadata, we constructed a set of heuristics to create questions and answers for DriveLM-CARLA.

Let me know if this answers your question :) Best, Katrin

Thank you for your reply, can you publish the code for the part "constructed a set of heuristics to create questions and answers", or can you provide more detailed information?

hutchinsonian avatar Mar 02 '24 14:03 hutchinsonian

Hi, we have released the full CARLA-data now. It is based on an improved version of PDM-lite which was the base for the two winning entries of the CARLA challenge 2024. We also improved the VQA labels to include VQAs for most CARLA Leaderboard 2.0 scenarios. You can find the full driving dataset together with the VQA labels and the scripts to generate both in the branch DriveLM-CARLA.

RenzKa avatar Sep 29 '24 08:09 RenzKa

Hi, The drivelm carla vqas are available, but there are no train/test splits. Could you share information on this? How can I get the different train test splits? Thank you

ayesha-ishaq avatar Feb 14 '25 11:02 ayesha-ishaq