I will be your data engineer for databricks pyspark etl and lakehouse solutions

Pakistan

I speak English

Cloud Data Engineer

Hi, I'm Soban, a Data Engineer with 3+ years of hands-on experience in building and delivering end-to-end data solutions. I specialize in Snowflake, Airflow, Kafka, Azure Data Factory, ADLS Gen2, Data...
About this Gig

I will build robust data pipelines and lakehouse solutions using Databricks, PySpark, Apache Spark, Spark SQL, and Delta Lake.

What I can build:

Databricks ETL/ELT pipelines

PySpark data transformations

Batch data processing

Delta Lake solutions

Medallion Architecture

Bronze, Silver & Gold data layers

Incremental data processing

Data cleansing and validation

SCD Type 1 / Type 2

Data modelling and analytics-ready datasets

I can work with structured data from CSV files, APIs, databases, and other supported sources and transform it into clean, reliable datasets for analytics and downstream applications.

Please contact me before ordering so I can review your requirements and recommend the appropriate package.

Expertise:

API integration

•

Big data

•

Data extraction

Technology:

Apache Kafka

•

Apache Spark

•

Python

•

SQL

•

Snowflake

My Portfolio

Other Data Engineering Services I Offer