arrow_back Spark Dynamic and Static Partition Overwrite

17 days ago link more_vert
J Jatin
articleArticles 0
imageDiagrams 0
codeCode 0
chat_bubble_outlineThreads 0
commentComments 1
loyaltyKontext Points 1
#1740 Re: Spark Dynamic and Static Partition Overwrite

I tried this however the data is getting completely overwritten i.e. even the partitions that are not changed are removed. I am running PySpark in AWS Glue with spark version 3.1. Below is the code snippet-

2022112050127-code.png



recommendMore from Kontext