I will build azure data factory and databricks etl pipelines

India

I speak English

Azure Databricks and Microsoft Fabric Data Engineer

Technical Lead Data Engineer with 4+ years building production data platforms on Azure, Databricks and Microsoft Fabric. I build lakehouses (bronze/silver/gold) with PySpark, Delta Lake, Azure Data Fa...
About this Gig

Need data moved, cleaned and ready for reporting? I build reliable ETL pipelines on Azure Data Factory and Databricks (PySpark, Delta Lake).


I'm a Technical Lead Data Engineer with 4+ years of production experience. Recent work: Spark jobs processing 5TB+ daily (30% faster), 15+ ADF pipelines moving 1.2M+ records a day, and a metadata-driven framework that cut new-source onboarding by 70%.


What I can build:

  • Ingestion from SQL Server, APIs, files (CSV, Excel, JSON), SharePoint or cloud storage
  • Bronze/silver/gold (medallion) lakehouse layers with Delta tables
  • Incremental loads, SCD Type 2, logging and retry handling
  • Data quality checks and failure alerts
  • Loads into Databricks, Snowflake, Azure SQL, Synapse or Microsoft Fabric

What you get: working pipeline code in your environment, a short run guide, and a walkthrough call if needed.


Please message me before ordering with your sources, destination and data size, so I can confirm the right package.

Destination Platform:

Snowflake

•

Azure Synapse Analytics

Tools & Platforms:

Microsoft SSIS

•

Azure Data Factory

•

Other

Other Data Engineering Services I Offer