Diagram

Spark Partitioning Physical Operators

Raymond Raymond
Raymond
Stats
articleArticles 551
codeCode 3
imageDiagrams 51
descriptionNotebooks 0
chat_bubble_outlineThreads 8
commentComments 278
loyaltyKontext Points 6098
account_circle Profile
visibility 100 access_time 10 months ago language English
info Last modified by Raymond 10 months ago copyright This page is subject to Site terms.
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

share
Twitter Facebook LinkedIn
more_vert
arrow_upward arrow_downward
tag Tags
info Info
Image URL
SVG URL

This diagram shows how Spark decides which repartition physical operators will be used for each scenario. 

repartition(numPartitions, *cols)