I will develop azure data factory etl pipelines with documentation
About this Gig
Hey there!
I help businesses get their data from source to destination reliably and on schedule. Most of my clients have been from the US and EU. Message me with your requirements and I'll share what I think would work best.
What I offer:
- Full load & incremental pipelines
- Multiple source connectivity (SQL, APIs, cloud storage, files)
- Data transformations using stored procedures or Data Flows
- Scheduling, Error handling, Validation & Logging
- Email alerting using ADF alerts & Logic apps.
- CI/CD Deployment
- Clear documentation
- Walkthrough calls
- Email support
My background:
- 5 years building production ADF pipelines
- Microsoft Certified: DP-203, AZ-900
- Experience with FMCG, construction, banking industry
- Handled implementations with 100+ tables
Sources I've worked with:
SQL Server, REST APIs, Dynamics 635, ADLS, On-premises file systems, Azure SQL Database etc.
Data formats I've worked with:
JSON, CSV, txt, Parquet, Zip, Excel, fixed-width files
Still not sure what you need? Message me with your situation I'll give you an honest assessment, no obligation.
Tools & Platforms:
Azure Data Factory
Other Data Engineering Services I Offer
FAQ
What information do you need to get started?
Source system details, target destination, list of tables/data, refresh frequency, and any transformation requirements. If you're not sure about everything, we can discuss.
Can you work in my Azure environment?
Yes, I can work directly in your Azure subscription. I'll just need appropriate access to Data Factory and related resources.
Can you connect to on-premises databases?
Yes, I can set up Self-Hosted Integration Runtime (SHIR) to securely connect ADF to your on-premises systems.
What if my project doesn't fit these packages?
Most projects are unique. Message me with your requirements and I'll create a custom offer.
Do you write documentation?
Yes, all packages include documentation — what the pipeline does, how to monitor it, and basic troubleshooting steps.
Can you deploy to multiple environments (dev/qa/prod)?
Yes, I can set up pipelines with parameterisation so they work across environments.

