I will develop end to end etl data pipelines using python, pyspark, and azure services

India

I speak Telugu, English

Azure and Palantir Data Engineer Python PySpark SQL ETL Pipelines

I am a Data Engineer with 2.8 years of experience working with Azure and Palantir Foundry. I specialize in building scalable ETL pipelines, data ingestion workflows, and transforming large datasets us...
About this Gig

I am a Data Engineer with 2.8 years of experience working with Azure and Palantir Foundry. I specialize in building scalable ETL pipelines and processing large datasets using Python, PySpark, and SQL.

I can design and develop efficient data pipelines, perform data transformation, and integrate data from multiple sources using modern data engineering tools.

Technologies I work with:

Python

PySpark

SQL

Azure Data Factory

Azure Data Lake

Palantir Foundry

Services I offer:

ETL pipeline development

PySpark data processing

SQL query optimization

Azure Data Factory pipelines

Palantir Foundry data pipelines

Data cleaning and transformation

I focus on delivering reliable, scalable, and production-ready data engineering solutions.

Expertise:

Big data

Data extraction

Data upload

ETL

Transformation

Technology:

Apache Spark

Azure data factory

Python

SQL

Databricks

My Portfolio