Browse categories
Explore
Fiverr Pro
English
$
USD
I will build azure data factory etl and data pipelines
About this Gig
Are you looking for help building, fixing, or optimizing an Azure Data Factory pipeline?
I provide Azure Data Engineering solutions for ingesting, transforming, and processing data using Azure Data Factory, Azure Data Lake Storage, Azure Databricks, PySpark, SQL and Delta Lake.
Services include:
- Azure Data Factory pipeline development
- SQL Server/CSV/API to Azure ingestion
- ADLS Gen2 integration
- Full and incremental data loading
- Watermark-based ingestion
- Azure Databricks and PySpark transformations
- Delta Lake MERGE/upsert implementation
- Pipeline debugging and error handling
- Parameterized and metadata-driven pipelines
- Performance optimization
I focus on building reliable and maintainable data pipelines based on your requirements.
Please message me before ordering if you have a complex or custom Azure Data Engineering requirement.
My Portfolio
FAQ
Can you fix an existing ADF pipeline?
Yes. I can troubleshoot pipeline failures, configuration issues, incremental-load problems and data movement issues.
Can you implement incremental loading?
Yes. I can implement watermark-based incremental ingestion using ADF and SQL.
Do you work with Azure Databricks?
Yes. I can implement PySpark transformations, Delta tables and MERGE/upsert processing.
Can you build an end-to-end Azure data pipeline?
Yes. Depending on your requirements, I can work across ADF, ADLS Gen2, Azure Databricks, SQL and Delta Lake.
