AWS Big Data Lambda Architecture for Streaming Analytics

Raymond Raymond
Raymond
Raymond
articleArticles 578
imageDiagrams 58
commentComments 304
loyaltyKontext Points 6374
 event 2022-01-11 visibility 618 comment 0
ios_share
X Facebook LinkedIn
more_vert

This diagram shows a typical lambda streaming processing solution on AWS with Amazon Kinesis, Amazon Glue, Amazon S3, Amazon Athena and Amazon Quicksight:

  • Amazon Kinesis - capture streaming data via Data Firehose and then transform and analyze streaming data using Data Analytics; the result of analytics is stored into another Data Firehose process; for batch processing, the captured streaming data can be directly loaded into S3 bucket too. 
  • Amazon S3 - store streaming raw data and batch processed data.
  • Amazon Glue - transform batch data in S3 and store the processed data into another bucket for consumption.
  • Amazon Athena - used to read data in S3 via SQL.
  • Amazon Quicksight - data visualization tool. 

References

comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

tag Tags
info Info
Image URL
SVG URL