AWS ETL Solution with Glue Diagramimage

visibility 137 access_time 4 months ago languageEnglish

This diagram shows one example of using AWS Glue to crawl, catalog and perform data stored in S3. 

  1. Data landed in raw bucket is scanned by Glue Crawler and the metadata is stored in Glue Catalog.
  2. Glue ETL job loads the raw data and does transformations and eventually store the processed data in curated bucket.
  3. The processed files are scanned by Glue Crawler.
  4. Processed data is then queried by Amazon Athena. The data can be further utilized in reporting and dashboard. 
info Last modified by Raymond 4 months ago copyright This page is subject to Site terms.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

comment Comments
No comments yet.
timeline Stats
Page index 1.21
local_offer Tags

info Info
Image URL
SVG URL
URL
More from Kontext
[Diagram] Data Engineering - Transactional Extract image
visibility 14
thumb_up 0
access_time 6 months ago
Data Engineering - Transactional Extract
Apache Ignite Installation on Windows
visibility 177
thumb_up 0
access_time 5 months ago
[Diagram] AWS EMR Read and Write with S3 image
visibility 19
thumb_up 0
access_time 23 days ago
AWS EMR Read and Write with S3