Browse categories
Explore
Fiverr Pro
English
$
USD
I will build data pipelines using databricks, pyspark, azure and sql
About this Gig
I will build, optimize, or troubleshoot data pipelines using Databricks, PySpark, Azure Data Factory, Azure Data Lake, Delta Lake, and SQL.
With 5+ years of enterprise data engineering experience, I can help you turn raw data into reliable, scalable, and maintainable data pipelines.
My services include:
ETL/ELT pipeline development
Databricks & PySpark development
Azure Data Factory orchestration
Data ingestion and transformation
SQL development and optimization
Delta Lake solutions
Batch and incremental processing
Data quality checks and validation
Pipeline troubleshooting and optimization
Data migration to Databricks
Unit testing and technical documentation
Whether you need a new pipeline, want to fix an existing workflow, or need help modernizing a data platform, I can work with your existing architecture and requirements.
I focus on clean implementation, scalable Spark processing, reliable data workflows, and clear documentation.
Please message me before placing an order with your requirements, source/target details, and expected deliverables so I can confirm the scope and recommend the appropriate package.
Tools & Platforms:
Azure Data Factory
•
Other
FAQ
1. What technologies do you work with?
Databricks, PySpark, Azure Data Factory, Azure Data Lake, Delta Lake, SQL, and related Azure data services.
2. Can you build a complete ETL pipeline?
Yes. Depending on the package, I can handle ingestion, transformation, orchestration, data quality checks, testing, and documentation.
3. Can you fix an existing Databricks or PySpark pipeline?
Yes. I can troubleshoot errors, review existing code, identify bottlenecks, and implement improvements.
4. Can you migrate existing pipelines to Databricks?
Yes. I can help migrate and modernize existing data workloads using Databricks, PySpark, and Delta Lake.
5. What information do you need to start?
Please provide your requirements, source and target systems, sample data/schema where applicable, existing code or pipelines, and expected output.
6. Can you handle custom requirements?
Yes. If your requirement doesn't fit the listed packages, please contact me first so we can define the scope and create a custom offer.
