MultiBench icon indicating copy to clipboard operation
MultiBench copied to clipboard

Question regarding the DHG-14/28 dataset

Open mashrurmorshed opened this issue 4 years ago • 3 comments

Hello. I wished to open a PR sometime to add support for the DHG-14/28 dataset [ site | paper ]. It's a challenging dynamic hand-gesture recognition dataset consisting of three modalities:

  • Depth videos / sequences of 16-bit depth-maps, at resolution 640x480
  • Sequences of 2D skeleton coordinates (in the image space) of 22 hand joints (frames, 22*2)
  • Sequences of 3D skeleton coordinates (in the world space), (frames, 22*3)

However, there's a small issue: the standard evaluation process of this dataset is a bit different from the norm.

There are exactly 2800 data instances in the dataset, performed by 20 unique people. Benchmarks on this dataset are evaluated through a 20-fold, 'leave-one-out' cross validation process. Models are trained 20 times: each time 19 people's data is used for training, while 1 person's data is strictly isolated and used as validation. This prevents any data leakage, and is supposed to increase the robustness of the evaluation.

The instructions in MultiBench mention implementing get_dataloader and having it return 3 dataloaders for train, val and test respectively. However there is no test in this dataset, rather 20 combinations of train and val.

Would it be okay to implement it in such a way that it returns training and validation dataloaders only?

mashrurmorshed avatar Nov 03 '21 14:11 mashrurmorshed

Hello, I'm currently working on a project related to dynamic hand gesture recognition and would like to use the DHG14/28 dataset. Unfortunately, the official link (http://www-rech.telecom-lille.fr/DHGdataset/) doesn't open for me — it seems to be down or inaccessible from my region. Would it be possible for you to provide an alternative download link or upload it to a cloud service like Google Drive or Dropbox? Thank you in advance for your support.

AthenaAzizi avatar May 09 '25 07:05 AthenaAzizi

@AthenaAzizi , have you found a working link ?

saydek217 avatar May 13 '25 09:05 saydek217

@saydek217 NO:(

AthenaAzizi avatar May 20 '25 07:05 AthenaAzizi