I will build azure data factory, databricks pyspark etl pipelines

India

I speak English

I will deploy microsoft azure cloud computing virtual desktop

I’m a Microsoft Azure Certified with 5+ years of experience as an Azure Data Engineer, skilled in Azure Data Factory (ADF), Databricks, PySpark, SQL, and Python. Proficient in building scalable data p...
About this Gig

I provide Azure Data Engineering consulting for ETL/ELT pipelines, cloud data architecture, performance optimization, and implementation planning. My expertise includes: Azure Data Factory pipeline design Azure Databricks and PySpark ADLS Gen2, Azure SQL, and Delta Lake Medallion Architecture Batch, incremental, and CDC loading SQL, API, CSV, and JSON ingestion Data quality and error handling Spark and SQL optimization Snowflake and Azure Synapse integration Cloud performance and cost optimization Based on your package, I can review your data environment, identify design or performance issues, recommend suitable Azure services, create an architecture diagram, and provide practical ETL pipeline recommendations. I focus on scalable architecture, reliable data movement, efficient processing, optimized cluster usage, clear communication, and actionable technical guidance. Please contact me before ordering and share your source, target, data volume, Azure environment, requirements, and expected outcome so I can recommend the correct package.

Langugae:

English

Hindi

Technical expertise:

dbt (Data Build Tool)

Apache Spark

Expertise:

Data Pipelines

ETL Development

Data Lake Setup

Industry:

Data analytics

Financial services

Food & beverage