Delta Lake Architecture

2022-08-25 data-lakedelta-lake

This diagram shows the architecture of Delta Lake.

Delta Lake is an open-source storage framework that can be use to build a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive. It publishes APIs for Scala, Java, Rust, Ruby, and Python.

Streaming Data Sources
[Not supported by viewer]
Batch Data Sources
[Not supported by viewer]
Delta Lake
[Not supported by viewer]
Ingestion Tables 
(Bronze Layer)
[Not supported by viewer]
Refined Tables 
(Silver Layer)
[Not supported by viewer]
Feature / Aggregated Tables 
(Gold Layer)
[Not supported by viewer]
Google Cloud
Storage
[Not supported by viewer]
Azure
Data Lake Storage
[Not supported by viewer]
AWS S3
[Not supported by viewer]
Data Analytics and Machine Learning, etc.
[Not supported by viewer]
Other Supported Storage
[Not supported by viewer]
MsPortalFx.base.images-24 public:true sdk: MsPortalFx.Base.Images.Polychromatic.FolderBlank() category: General image/svg+xml MsPortalFx.base.images-24 MsPortalFx.base.images-24 public:true sdk: MsPortalFx.Base.Images.Polychromatic.FolderBlank() category: General image/svg+xml MsPortalFx.base.images-24 MsPortalFx.base.images-24 public:true sdk: MsPortalFx.Base.Images.Polychromatic.FolderBlank() category: General image/svg+xml MsPortalFx.base.images-24 Icon-storage-86 public:true sdk:MsPortalFx.Base.Images.Polychromatic.Storage() category: Storage image/svg+xml Icon-storage-86