I will build or fix your azure databricks and pyspark data pipelines

India

I speak Hindi, English, Punjabi, French

Azure Databricks and PySpark Data Engineer

Azure Data Engineer with ~4 years building production lakehouse pipelines on Azure Databricks, PySpark, Azure Data Factory, Delta Lake and Unity Catalog, mostly for a large global health-tech platform...
About this Gig

Need a reliable pipeline on Azure Databricks, or one that keeps failing? I am an Azure Data Engineer with about 4 years of building production lakehouse pipelines on Databricks, PySpark, Azure Data Factory, Delta Lake and Unity Catalog.


What I do:

  • New pipelines: ingest files, APIs or databases into Delta Lake (bronze, silver, gold)
  • Fix failing notebooks, jobs and ADF pipelines
  • Incremental loads, merges and upserts (SCD), schema evolution
  • Data quality checks, logging and alerting
  • Clear documentation so your team can run it

How we work: share your notebook or code and sample data (dummy data is fine), or give me least-privilege workspace access through your own admin. Please never send passwords or keys.


I use AI-assisted tooling, and every delivery is tested and documented by me.


Please message me before ordering so I can confirm scope and timeline.

Destination Platform:

Azure Synapse Analytics

Tools & Platforms:

Azure Data Factory