Project 1: ADF and SQL End-to-End Pipeline
- Ingest sales data from on-premises SQL Server
- Transform with ADF Copy Activity and mapping
- Load to Azure Data Lake Gen2 as Parquet
- Incremental delta load strategy
- Load to a Synapse SQL Pool for reporting
- Email alert through Logic Apps on failure
- Parameterized pipelines, with version control in Azure DevOps
Tools: SQL Server, ADF, ADLS, Synapse, Logic Apps
