I will build scalable data pipelines using python, pyspark and azure

Anup

India

I speak English

Data Engineer Specializing in Azure, PySpark and Big Data Pipelines

I am a Data Engineer with over 4 years of professional experience designing, building, and maintaining scalable data solutions. My expertise includes Python, SQL, PySpark, Databricks, Azure Data Facto...

About this Gig

Hi! Im a Data Engineer with 4+ years of hands-on experience building scalable, reliable, and high-performance data solutions.

I help businesses turn raw data into clean, analytics-ready datasets using Python, SQL, PySpark, Databricks, and Azure Data Factory. I have experience delivering end-to-end data pipelines from data ingestion and transformation to data modeling and performance optimization.

What I can help you with:

Designing and optimizing ETL / ELT pipelines
Azure Data Factory pipeline development, debugging, and enhancement
Large-scale data processing with Databricks & PySpark
Writing and optimizing SQL queries for analytics and reporting
Data modeling (star schema, snowflake, dimensional models)
Processing and managing big data workloads

I focus on clean architecture, scalability, performance, and data reliability. Whether youre a startup building your first data platform or an established business improving existing pipelines, I deliver production-ready, well-structured solutions you can rely on.

Message me before placing an order Ill review your requirements and recommend the best solution for your needs.