Browse categories
Explore
Fiverr Pro
English
$
USD
I will build end to end azure data pipeline using adf and databricks
About this Gig
I will build an end-to-end data engineering solution to ingest, transform, process, and prepare your data for analytics.
I specialize in Azure, Azure Data Factory, Azure Databricks, PySpark, Python, SQL, ADLS Gen2, and Delta Lake.
What I can build:
- ETL/ELT data pipelines
- API, CSV, Excel & SQL data ingestion
- Azure Data Factory orchestration
- ADLS Gen2 data lake solutions
- Databricks & PySpark transformations
- Delta Lake & Medallion Architecture
- Batch & incremental data processing
- SCD Type 1 / Type 2
- Data modelling & analytics-ready datasets
- Data quality and validation
- Power BI-ready data layers
Typical architecture:
Source ADF ADLS Databricks/PySpark Delta Lake Gold Layer Analytics
Whether you need a new pipeline, an existing pipeline optimized, or a complete data platform, I can design the solution around your requirements.
Have a project in mind? Contact me before ordering so I can understand your requirements and recommend the right solution.
Tools & Platforms:
Azure Data Factory
My Portfolio
FAQ
What data sources can you work with?
I can work with CSV,JSON, Excel, REST APIs, and relational databases such as SQL Server, depending on the project requirements.
Can you work with existing pipelines?
Yes. I can troubleshoot, optimize, modify, and extend existing data pipelines based on their architecture and requirements.
Do you provide complete end-to-end solutions?
Yes. For larger projects, I can work across ingestion, storage, transformation, data modelling, and analytics-ready data layers.
