toolkit icon indicating copy to clipboard operation
toolkit copied to clipboard

About dataset overlap

Open zyandtom opened this issue 1 year ago • 1 comments

On which dataset did you conduct the evaluation? Acoording to https://arxiv.org/abs/2312.06420, the train, test and eval scenarios of Nuscenes/Argoverse dataset have geographical overlap which may cause data leakage.

zyandtom avatar Jul 08 '24 12:07 zyandtom

Hi @zyandtom, thanks for your interest in MapBench! MapBench is constructed by corrupting the val set of nuScenes. We chose nuScenes since it has been widely utilized among almost all recent HD map construction works.

mapbench avatar Jul 09 '24 23:07 mapbench