Streaming Big Data to Azure Synapse via Azure Data Factory

Raymond Raymond
visibility 969 access_time 2 years ago language English

This diagram shows a typical solution to stream big data to Azure Synapse:

  1. Data produced are streamed into Azure Event Hubs.
  2. Data in Event Hubs are captured in Azure Blob Storage via Event Hubs Capture feature.
  3. Once data capture is complete, an event is sent to Event Grid.
  4. Event Grid forwards the event information (with blob file path) to Azure Factory Pipeline (i.e. Event Grid triggered pipeline).
  5. Azure Data Factory uses event data (blob path) as source.
  6. Azure Data Factory sinks data to Azure Synapse SQL data warehouse for analytics.  
copyright This page is subject to Site terms.
comment Comments
No comments yet.

Please log in or register to comment.

account_circle Log in person_add Register

Log in with external accounts

tag Tags
info Info
Image URL