I will fix and optimize etl data pipelines with airflow or nifi

Pakistan

I speak English, Urdu, Punjabi, German

Big Data Engineer

Senior Data Engineer with 7+ years building production-grade data pipelines and lakehouses for enterprise clients. I specialize in Apache NiFi, Airflow, Spark ETL, and data warehouse design using Hive...

About this Gig

Is your data pipeline unreliable, slow, or just not built yet? I'll design and deliver a production-ready pipeline tailored to your architecture.

What I offer:

Apache NiFi pipeline design and deployment (Docker or Kubernetes)
Airflow DAG development scheduling, retries, alerting, dependencies
PySpark and Spark SQL ETL jobs for large-scale data transformation
Ingestion from REST APIs, SAP OData, S3/MinIO, databases and flat files
Custom NiFi processors in Java for complex business logic

Why work with me:

7+ years of real enterprise experience building pipelines for German corporate clients
I've built pipelines handling millions of records across complex multi-source architectures
Every delivery includes error handling, logging and documentation not just working code

I do NOT do: