DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

Fix DeepspeedDataLoader length

Open lkm2835 opened this issue 3 years ago • 1 comments

len(DeepspeedDataLoader) is currently equal to len(data_sampler) = len(dataset) / data_parallel_world_size.

But, len(DataLoader) is equal to len(dataloader) = len(data_sampler) / batch_size.

lkm2835 avatar Apr 22 '22 02:04 lkm2835

Can one of the admins verify this patch?

rocm-mici avatar Jun 09 '22 20:06 rocm-mici