Partitioners

Partitioning of RDDs is done by partitioners. Partitioners assign a partition index to the elements in the RDD. All elements in the same partition will have the same partition index.

Spark comes with two partitioners the HashPartitioner and the RangePartitioner. In addition to these, you can also implement a custom partitioner.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
18.116.36.174