I will build azure databricks pyspark and adf etl data pipelines

India

I speak English, Telugu, Hindi

Azure Data Engineer

I am an Azure Data Engineer with 3 years of experience in Azure Databricks, PySpark, Apache Spark, SQL, Azure Data Factory, ADLS Gen2, Delta Lake, Unity Catalog, Structured Streaming, and Azure DevOps...
About this Gig

Need help building, improving, or troubleshooting an Azure data pipeline? I can help you design and implement reliable data engineering solutions using Azure Databricks, Azure Data Factory, PySpark, SQL, ADLS, and Delta Lake.

With hands-on experience in building ETL/ELT pipelines, I can help with:

Azure Databricks development and troubleshooting

PySpark data transformations and performance optimization

SQL queries, data analysis, and query optimization

Azure Data Factory pipelines and data movement

ETL/ELT pipeline development

Delta Lake implementation and optimization

Structured Streaming and batch processing

Data cleaning, validation, and transformation

Medallion Architecture using Bronze, Silver, and Gold layers

ADLS integration with Databricks

Pipeline debugging and fixing existing issues

Data pipeline design and architecture diagrams

I focus on understanding the actual requirement before building a solution. Whether you need a small transformation, help fixing an existing pipeline, or support with a larger data engineering task, I will provide clean, maintainable, and practical solutions.

Please message me before placing an order so we can discuss your requirements.

Langugae:

English

Technical expertise:

Apache Spark

Databricks

Expertise:

Data Pipelines

ETL Development

Data Warehousing

Industry:

Data analytics

Financial services

Sports & fitness