EasyNLP

EasyNLP copied to clipboard

Reame
Issues

Buffered shuffle on odps dataset

Open hlh981029 opened this issue 3 years ago • 0 comments

https://discuss.pytorch.org/t/how-to-shuffle-an-iterable-dataset/64130/5

torch 1.8.1 torch.utils.data.BufferedShuffleDataset
latest torch.utils.data.datapipes.iter.combinatorics.ShuffleIterDataPipe

Jun 28 '22 04:06 hlh981029