geeraay

Hi @nikhilrayaprolu, I faced the same problem with you, it was because the preprocessing script on whole cnndm training dataset took more than 32GB RAM. I would suggest you to...

I don't remember the exact step I've done back then, but the idea is this. I did something like `split -n l/${nsplit} /path-to-file/train.source /path-to-file/train.source.` it will create train.source.00, train.source.01, ......