Diagram

Spark Partitioning Physical Operators

Raymond Raymond
Raymond
Stats
articleArticles 554
codeCode 5
imageDiagrams 52
descriptionNotebooks 0
chat_bubble_outlineThreads 8
commentComments 296
loyaltyKontext Points 6161
account_circle Profile
visibility 145 access_time 2 years ago language English

This diagram shows how Spark decides which repartition physical operators will be used for each scenario. 

repartition(numPartitions, *cols)
info Last modified by Raymond 2 years ago copyright This page is subject to Site terms.
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

share
Twitter Facebook LinkedIn
more_vert
arrow_upward arrow_downward
tag Tags
info Info
Image URL
SVG URL