I will create azure resources for data migration needs
Azure Cloud Engineer Expert in ETL ADF CDC LSN PySpark SQL PowerBI
About this Gig
Hey there,
Welcome to my Upwork profile!
I bring a wealth of experience as an Azure Data Engineer with a strong background in various projects on the Azure platform. My expertise lies in Azure Data Factory pipeline development and Azure Synapse Analytics. From establishing connections to data sources, constructing ETL pipelines, and crafting logical and conceptual database models, I specialize in end-to-end automation, particularly for incremental data loads.
Furthermore, I possess proficiency in data mining using APIs such as Beautiful Soup. Alongside, I offer skills in Business Intelligence, data warehousing, and the creation of insightful reports and dynamic dashboards.
Here's a snapshot of my toolset and skills:
- Azure Data Factory
- Azure Synapse Analytics
- Azure SQL Database
- Python
- PySpark
- Power BI
- Incremental ETL transformations
- Dynamic Metadata Driven Pipelines
- CDC with LSN for incremental data load
Looking forward to the opportunity to collaborate on exciting projects!
Technology:
Azure data factory
•
SQL
My Portfolio
FAQ
Which Azure subscription will we use for pipeline development?
You will kindly provide me with the Azure subscription, and I'll be more than happy to utilize it to create the necessary resources for completing the task. Your cooperation is greatly appreciated!
Data security?
I will never download the data during the transformation or at any phase of development. I will create resources in your provided Azure resource group in the subscription.
What if I don't want to give you access to the data?
Sure, you will provide me with the sample data. I will complete the pipeline. Once everything is ready, In your presence I will share my screen and I will connect the pipeline to the source.

