This site uses cookies to deliver our services. By using this site, you acknowledge that you have read and understand our Cookie and Privacy policy. Your use of Kontext website is subject to this policy. Allow Cookies and Dismiss

Tag - pyspark

pyspark

Implement SCD Type 2 Full Merge via Spark Data Frames

72 views   0 comments last modified about 19 days ago

Overview For SQL developers that are familiar with SCD and merge statements, you may wonder how to implement the same in big data platforms, considering database or storages in Hadoop are not designed/optimised for record level updates and inserts. In this post, I’m going to demons...

View detail

Contacts

  • enquiry[at]kontext.tech

Subscribe