access_time 3y languageEnglish
Implement SCD Type 2 Full Merge via Spark Data Frames
visibility 19,085 comment 3
For SQL developers that are familiar with SCD and merge statements, you may wonder how to implement the same in big data platforms, considering database or storages in Hadoop are not designed/optimised for record level updates and inserts. In this post, I’m going to demonstrate how to implement ...
info Last modified by Administrator 2y