I will be your databricks, azure, gcp data engineer

Reliable, Scalable & Cloud-Native Data Pipelines | Azure & Databricks Specialist

Struggling to move, transform, or scale your data reliably? I build end-to-end, production-grade data pipelines that automate ingestion, transformation, validation, and deployment fully cloud-native and CI/CD driven.

I bring hands-on expertise in PySpark, Spark SQL, Python, SQL, Databricks, Azure, and GCP to turn raw, messy data into clean, trusted, analytics-ready datasets.

What I offer:

• ETL & ELT pipeline design (batch & streaming)
• PySpark & Spark SQLbased data transformation at scale
• Databricks development with Databricks Asset Bundles (DAB) for repeatable, version-controlled deployments
• CI/CD pipeline setup using Azure DevOps (build, release, automated testing & deployment)
• Secure integration using Service Principals for authentication across environments
• Cloud-native deployment: Azure Data Factory, Azure Data Lake, Azure SQL, Databricks, GCP Dataflow, BigQuery
• API, database, and cloud storage integrations
• Real-time streaming architecture (Kafka / Event Hubs / Pub-Sub)
• End-to-end DevOps practices: version control, environment promotio