I will build azure databricks pyspark and adf etl data pipelines
About this Gig
Need help building, improving, or troubleshooting an Azure data pipeline? I can help you design and implement reliable data engineering solutions using Azure Databricks, Azure Data Factory, PySpark, SQL, ADLS, and Delta Lake.
With hands-on experience in building ETL/ELT pipelines, I can help with:
Azure Databricks development and troubleshooting
PySpark data transformations and performance optimization
SQL queries, data analysis, and query optimization
Azure Data Factory pipelines and data movement
ETL/ELT pipeline development
Delta Lake implementation and optimization
Structured Streaming and batch processing
Data cleaning, validation, and transformation
Medallion Architecture using Bronze, Silver, and Gold layers
ADLS integration with Databricks
Pipeline debugging and fixing existing issues
Data pipeline design and architecture diagrams
I focus on understanding the actual requirement before building a solution. Whether you need a small transformation, help fixing an existing pipeline, or support with a larger data engineering task, I will provide clean, maintainable, and practical solutions.
Please message me before placing an order so we can discuss your requirements.
