ffcv icon indicating copy to clipboard operation
ffcv copied to clipboard
verified publisher icon libffcv

Split Dataloader using indices

Open JJGO opened this issue 3 years ago • 0 comments

Trying to decide how to do 5-fold cross-validation with FFCV loading.

Does FFCV have any way of supporting loading just a subset of the indices, or should I have 5 files and loaders around for each split? Not sure how the overhead of multiple loaders stacks up (thinking about num_workers here).

JJGO avatar Jul 28 '22 22:07 JJGO