Diagram Raymond Raymond

Streaming Big Data to Azure Synapse via Azure Data Factory

event 2021-12-24 visibility 1,196 comment 0

This diagram shows a typical solution to stream big data to Azure Synapse:

  1. Data produced are streamed into Azure Event Hubs.
  2. Data in Event Hubs are captured in Azure Blob Storage via Event Hubs Capture feature.
  3. Once data capture is complete, an event is sent to Event Grid.
  4. Event Grid forwards the event information (with blob file path) to Azure Factory Pipeline (i.e. Event Grid triggered pipeline).
  5. Azure Data Factory uses event data (blob path) as source.
  6. Azure Data Factory sinks data to Azure Synapse SQL data warehouse for analytics.  
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

tag Tags
info Info
Image URL