I will be your data engineer using python and pyspark on AWS, gcp, and azure

Kenya

I speak English, German, French

1 order completed

Data Engineer

I specialize in end-to-end data engineering, including data architecture, ETL/ELT pipelines, big data processing, and real-time streaming. I build cloud-native solutions on AWS, GCP, and Azure, levera...
About this Gig

I am a Data Engineer with 10+ years of experience building production-grade data platforms across cloud and distributed systems. I hold a Masters degree in Cloud Computing and Distributed Systems and have worked with clients ranging from startups to Fortune 500 companies, delivering high-performance architectures that process billions of events with low latency and high reliability.

I help organizations turn raw data into scalable, analytics-ready systems by designing and implementing end-to-end data engineering solutions.

Core Expertise

  • Data Architecture & Strategy Scalable, secure architectures aligned with business and compliance needs
  • Batch & Streaming Pipelines ETL/ELT using Spark, PySpark, Flink, Kafka
  • Cloud Data Engineering AWS, GCP, Azure, including Databricks, Data Factory, Dataflow, S3, BigQuery
  • Data Integration & APIs API ingestion into data lakes, warehouses, and databases
  • Analytics Enablement Pipelines for Power BI, Tableau, Qlik, and dashboards
  • Databricks & PySpark Workflow and pipeline development
  • Databases SQL optimization and warehousing; NoSQL (MongoDB, Cassandra)
  • Automation & Orchestration Airflow, NiFi
  • ML Enablement Data platforms optimized for machine learning

Langugae:

English

French

German

Technical expertise:

Apache Airflow

Databricks

Snowflake

Expertise:

Data Pipelines

ETL Development

Data Warehousing

Industry:

Crypto & blockchain

Cyber security

Financial services