Browse categories
Explore
Fiverr Pro
English
$
USD
I will build an elt pipeline with python, airflow, and dbt
Data Engineer, ETL Pipelines, Python, Airflow and dbt
I build production-ready data pipelines, ELT workflows, and analytics-ready data models for startups and businesses that need reliable infrastructure. Certified in Microsoft Fabric, Power BI, and expe...
About this Gig
Is your data scattered across sources with no reliable pipeline to move, clean, and deliver it where it needs to go?
I build production-ready ETL and ELT pipelines using Python, Apache Airflow, and dbt, automated, tested, and documented so your team can maintain them without me.
WHAT YOU GET:
- Custom ETL/ELT pipeline built to your data sources
- Apache Airflow DAGs with scheduling and retry logic
- dbt transformation models with data quality tests
- Incremental and full-load patterns
- Git version-controlled, documented codebase
- Delivery to Snowflake, BigQuery, Redshift, or Postgres
WHY CHOOSE ME:
Microsoft Certified Data Engineer. Built Medallion Lakehouse on Microsoft Fabric. Proficient across Python, SQL, PySpark, Airflow, dbt, Kafka, Snowflake, and BigQuery.
Every pipeline I deliver runs in production, not just in a notebook.
Message me before ordering so I can confirm your stack is a fit.
FAQ
What data sources can you connect to?
I can build ETL pipelines from REST APIs, PostgreSQL, MySQL, MongoDB, flat files (CSV, JSON, Parquet), Google Sheets, S3, and most SaaS platforms. If you have a specific source, message me before ordering.
Which data warehouses do you support?
I deliver to Snowflake, Google BigQuery, Amazon Redshift, PostgreSQL, Microsoft Fabric, and Azure Synapse. I can also target Delta Lake or Apache Iceberg formats on cloud storage.
Do you use Apache Airflow for orchestration?
Yes. I build Airflow DAGs with scheduling, retry logic, alerting, and dependency management. I can also use Prefect if you prefer a lighter orchestration tool.
What is dbt and do I need it?
dbt (data build tool) handles the transformation layer in your ELT pipeline using SQL. It adds data quality tests, auto-documentation, and version control. I recommend it for any warehouse-based project.
Will the pipeline run automatically on a schedule?
Yes. All pipelines include automated scheduling via Airflow or cron. You choose the frequency — hourly, daily, or event-triggered — and I configure it accordingly.
Do you provide documentation?
Yes. Every delivery includes a README, dbt auto-generated docs, and inline code comments. You will be able to understand, extend, and maintain the pipeline without me.
Can you work with my existing data stack?
Yes. Send me your current stack before ordering and I will confirm compatibility. I have worked with AWS, GCP, and Azure environments and can integrate into most existing setups.
Do you handle real-time streaming pipelines?
Yes. The Premium package includes Apache Kafka for real-time event-driven pipelines. If you need streaming on a smaller scope, message me and I will quote accordingly.
What do you need from me to start?
I need your data sources, destination warehouse, transformation logic or business rules, and access credentials. I will provide a checklist after you place the order.
Is the code version-controlled?
Yes. All code is delivered via a Git repository with a clean commit history. I follow software engineering best practices — no zip files of loose scripts.
