Chris Severs
Chris Severs
I'm running into this issue in the latest version built off of #132 The code I'm running is pretty simple: ``` scala val input = sc.sequenceFile[VectorWritable, VectorWritable](inputPath, classOf[VectorWritable], classOf[VectorWritable]) //...
Just to make it simpler you can change the input to something like: val input = sc.parallelize(1 to 100000000, 400) and change the flatMap input appropriately and see the same...
@ankurdave I've tried it with 4-8 cores. I can try with 1 if you think it would help pin down what's going on. edit: Just to be clear, I mean...
I'm going to be gone for a week starting tomorrow but I can take a look at this when I get back. Thanks!