I will build etl pipelines on databricks with spark

Hi, I'm a Data Engineering Consultant with 5+ years building production data pipelines on Databricks.

I've architected real Databricks workloads in production, including a Customer Data Platform processing large-scale datasets with PySpark, Delta Live Tables, and medallion architecture. I build on Databricks daily not just as a buzzword.

What I'll build for you:

• End-to-end ETL pipelines (batch or streaming)
• Bronze Silver Gold medallion architecture
• Delta Lake with ACID, schema evolution, time travel
• Optimized PySpark transformations
• Ingestion from APIs, SQL Server, MySQL, Postgres, ADLS, S3, GCS, CSV, JSON, Parquet
• Incremental loads with MERGE INTO and CDC
• Autoloader, job scheduling, workflow orchestration
• Clean, modular, version-controlled code

Why work with me:

• Real production experience not tutorials
• 5 years across Databricks, Fabric, dbt, BigQuery, Synapse
• Parameterized, testable, reusable code
• Documentation with every delivery
• Fluent English and detailed updates

Tech stack:

• Databricks
• PySpark
• Delta Lake
• DLT
• Unity Catalog
• ADLS
• S3
• SQL Server
• Python
• Git

Before you order:

Message me with your complete requirements.