access_time 4 months ago
SCD Type 2 - Implement FULL Merge with Delta Lake Table via PySpark
Slowly Changing Dimension has been commonly used in traditional data warehouse projects. It doesn't only save storage space but also make certain query pathways easier. Thus, in data lake context, it is still relevant. This article shows you how to implement a FULL merge into a delta SCD type 2 ...
info Last modified by Raymond 4 months ago