toolkit
toolkit copied to clipboard
About dataset overlap
On which dataset did you conduct the evaluation? Acoording to https://arxiv.org/abs/2312.06420, the train, test and eval scenarios of Nuscenes/Argoverse dataset have geographical overlap which may cause data leakage.
Hi @zyandtom, thanks for your interest in MapBench! MapBench is constructed by corrupting the val set of nuScenes. We chose nuScenes since it has been widely utilized among almost all recent HD map construction works.