I will develop end to end etl data pipelines using python, pyspark, and azure services
Azure and Palantir Data Engineer Python PySpark SQL ETL Pipelines
About this Gig
I am a Data Engineer with 2.8 years of experience working with Azure and Palantir Foundry. I specialize in building scalable ETL pipelines and processing large datasets using Python, PySpark, and SQL.
I can design and develop efficient data pipelines, perform data transformation, and integrate data from multiple sources using modern data engineering tools.
Technologies I work with:
Python
PySpark
SQL
Azure Data Factory
Azure Data Lake
Palantir Foundry
Services I offer:
ETL pipeline development
PySpark data processing
SQL query optimization
Azure Data Factory pipelines
Palantir Foundry data pipelines
Data cleaning and transformation
I focus on delivering reliable, scalable, and production-ready data engineering solutions.

