Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard
verified publisher icon LAION-AI

Distributed Sampler

Open sanagno opened this issue 2 years ago • 0 comments

Make the current sampler work correctly for distributed training

  • split the dataset per epoch per device
  • fix small error that cased the fractions/sizes to be ignored

sanagno avatar Feb 25 '23 13:02 sanagno