SparkInternals icon indicating copy to clipboard operation
SparkInternals copied to clipboard

Should mention `RangePartitioner` in explaining `sortByKey`

Open darkjh opened this issue 11 years ago • 1 comments

在解释sortByKey的时候:

https://github.com/JerryLead/SparkInternals/blob/master/markdown/2-JobLogicalPlan.md

sortByKey实际使用的是RangePartitioner。分片排序之后,我们还需要分片之间的顺序关系才能最终输出排序后的结果。

代码:

https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/rdd/OrderedRDDFunctions.scala#L62

darkjh avatar Mar 12 '15 17:03 darkjh

谢谢指出,最近在忙paper,我会在下次review的时候修改的

JerryLead avatar Mar 17 '15 01:03 JerryLead