I will build expert pyspark data pipelines with databricks and delta lake

India

I speak Hindi, English

I will provide you Data Analytics, Python and Cloud Services

Hi, I’m Zia, a Dynamics 365 F&O Technical Consultant with 3+ years of experience, specializing in ERP and Azure-based data solutions. My expertise includes D365 F&O customizations and integrations (X...
About this Gig

Scalable Data Pipelines with PySpark, Databricks & Delta Lake

Tired of slow, unoptimized, or unreliable data pipelines? As a professional Data Engineer with 3.5+ years of experience, I specialize in architecting high-performance ETL/ELT solutions. I help businesses transform fragmented data into clean, production-ready datasets using the modern Lakehouse architecture.

My Technical Expertise:

  • PySpark & Databricks: Development of complex, distributed processing logic for big data.
  • Delta Lake: Implementing ACID transactions, schema enforcement, and time travel for reliable storage.
  • Workflow Orchestration: Expert automation using Azure Data Factory (ADF), Apache Airflow, and serverless Azure Functions.
  • Cloud Infrastructure: Hands-on experience with Azure, MinIO, and high-performance SQL optimization.

Why Work With Me?

I focus on architectural stability and compute efficiency. My background in complex ERP integrations and data engineering research ensures your pipelines are built for long-term scalability, not just a quick fix.

Please message me before placing an order. Every data project has unique requirements, and a brief technical alignment is essential to provide the most accurate

Expertise:

API integration

Big data

Data extraction

Data flow

ETL

Technology:

Apache Spark

Azure data factory

Excel

Python