Browse categories
Explore
Fiverr Pro
English
$
USD
I will build etl data pipelines with python sql spark azure and palantir foundry
Data Engineer, Palantir Foundry, Spark, Azure and Python
Senior Data Engineer and full-stack developer focused on pipelines, analytics, automation, and data-driven apps. I work with Python, SQL, Spark, PySpark, Azure, Databricks, Palantir Foundry, Power BI,...
About this Gig
I design, build, and improve reliable data pipelines for analytics, reporting, and operational use cases.
I can help with:
ETL and ELT pipeline development
Python, SQL, Spark, and PySpark transformations
Azure and Databricks data workflows
Palantir Foundry pipelines, data modeling, and ontology work
API and file-based data ingestion
Data validation, transformation, and quality checks
Pipeline debugging and performance optimization
Technical documentation and maintainable source code
Power BI-ready datasets and reporting layers
Before ordering, please share the business objective, source and target systems, sample schema or data, expected volume and frequency, required transformations, platform constraints, and delivery expectations. I will review the scope and recommend the correct package.
Access to private systems must be provided through secure, approved methods.
Tools & Platforms:
Azure Data Factory
•
Other
My Portfolio
FAQ
Do you work with large datasets?
Yes. I can design Spark and PySpark transformations for large datasets. Please share the approximate volume, frequency, environment, and performance requirements so I can confirm the scope.
Can you automate the ETL process?
Yes. I can automate scheduled ETL or ELT workflows using the agreed platform, including Azure Data Factory, Databricks, or Palantir Foundry where appropriate.
Does this gig include machine learning workflows?
I can prepare and automate the data pipeline around an ML workflow. Model development or MLOps must be reviewed and scoped separately based on the data, platform, and deployment needs.
Can you prepare data for Power BI or reporting?
Yes. I can create validated, reporting-ready datasets and transformation layers for Power BI. Dashboard development can be included when agreed in the scope.
