I will create, update airflow dags, end to end project support in docker setup, dags
Data Engineer: dbt, BigQuery, PySpark, Python, SQL, GCP, AWS
Level 1
Has met certain performance criteria and shows strong potential in the marketplace.
About this Gig
I will create, update, and optimize Apache Airflow DAGs and provide end-to-end project support. Whether you need new pipelines, existing DAG enhancements, or a complete Airflow setup in Docker, I will help you build scalable, efficient, and production-ready workflows tailored to your needs.
I can help you with ETL/ELT pipelines, data orchestration, workflow automation, Docker-based Airflow setup, API/database integrations, and performance optimization to ensure your pipelines run faster, smoother, and with fewer failures.
Whats included:
- Creating new Airflow DAGs from scratch
- Updating and refactoring existing DAGs
- Setting up Airflow in Docker with configurations
- Designing end-to-end ETL/ELT pipelines
- Integrating APIs, databases, and external data sources
- Debugging, bug fixing, and resolving task failures
- Optimizing DAG performance for faster execution
- Setting up scheduling, dependencies, and orchestration
- Implementing monitoring, logging, and error handling
- Providing ongoing support for scaling and maintaining pipelines
Just shoot me a DM, and Ill get back to you right away to discuss your project needs.
