Reduction failing

[hacksysteam]

Hi @pyoor

Reduction is failing with 50,000+ files. It says killed, this is because python uses a lot of memory and host gets OOM.

Edit: Seems that we are leaking memory. My VM is of 2G RAM and 1 CPU.

Thanks.