I will build your big data projects using hadoop pyspark kafka and python

Morocco

I speak English

Data Engineer

Data Engineer specialized in Lakehouse architectures and ETL/ELT pipelines, with strong hands-on expertise in Big Data ecosystems including Hadoop, Spark, Kafka, Airflow, and Apache Iceberg. Microsoft...
About this Gig

️ Please message me before ordering!

Are you looking for a Microsoft Certified Data Engineer to help you with Big Data projects, pipelines, or analytics? You are in the right place.

I am a professional Big Data Engineer specialized in Hadoop, Spark, PySpark, Kafka, and Python, with additional expertise in Microsoft Azure, Microsoft Fabric, and Lakehouse architectures giving you the best of both open-source and cloud ecosystems.

What I will do for you:

  • PySpark & Spark development and optimization
  • Hadoop cluster setup, configuration and tuning (HDFS, YARN, MapReduce)
  • Apache Kafka real-time streaming pipelines
  • Apache Airflow pipeline orchestration and scheduling
  • Apache Iceberg table format for Lakehouse architecture
  • ETL/ELT job development, testing and deployment
  • Python scripts for data processing and automation
  • Built-in Data Quality checks and validation
  • Big data analytics and reporting ready for Power BI

Why choose me over others:

  • Microsoft Certified Data Engineer
  • Expert in both open-source Big Data & Azure cloud
  • Lakehouse architecture specialist
  • Clean, documented, production-ready code
  • Fast delivery & clear communication
  • Free consultation before ordering

Let's turn your raw data in

Expertise:

Big data

Data extraction

Data flow

ETL

Transformation

Technology:

Apache Hadoop

Apache Kafka

Apache Spark

Python

SQL

Other Data Engineering Services I Offer

Related tags