I will be your data engineer for airflow, spark and dbt projects
About this Gig
I build and fix data pipelines with Airflow, dbt and Spark.
I lead the data platform at a large e-commerce marketplace: 1,000+ Airflow DAGs, 600 TB of data, 130+ data users. I have worked in data engineering since 2019.
What I can do for you:
- Fix failing or slow Airflow DAGs, Spark jobs and dbt models
- Build ETL/ELT pipelines from databases, APIs and files into your warehouse
- Set up Airflow, dbt and Spark in Docker or Kubernetes
- Design tables in ClickHouse, PostgreSQL, Trino and Iceberg
- Stream database changes with Debezium and Kafka
- Add data quality tests and alerts
How I work:
- You describe the task, and we agree on scope and deadline before you order.
- I work in your repository or deliver code you deploy yourself.
- You get working code, short docs and a handover call.
Message me before ordering so I can check that the task fits the package.
FAQ
What do you need from me to start?
A task description and access to the code
Can you work with my existing setup?
Yes. I can work in your repository, cloud or Kubernetes cluster, or deliver code that you deploy yourself.
What if my task doesn't fit a package?
Message me with the details. I'll send a custom offer with the right scope, deadline and price.
Do you take long-term work?
Yes. For ongoing support I can work monthly or hourly through a custom offer.
