I will build python etl pipelines using airflow and dbt
AI, Data and Software Developer, Apps, Agents and Automation
About this Gig
Need to automate data collection, transformation, and loading?
I'll build Python-based ETL pipelines to move data from your APIs, databases, spreadsheets, and other sources into your preferred destination.
What I can build:
- API data extraction
- CSV and Excel ingestion
- PostgreSQL and MySQL integrations
- Data transformation using Python and SQL
- Apache Airflow DAGs and scheduling
- dbt models and data tests
- BigQuery and PostgreSQL data loading
- Error handling, logging and documentation
- Docker-based development environments
I'm a data and software engineer with 7+ years of experience building backend systems, analytics applications and automated data workflows.
My focus is reliable pipelines that are maintainable, testable and easy to operate.
Please message me before ordering so we can confirm the data sources, destination, volume and scheduling requirements.
My Portfolio
FAQ
Can you connect APIs to PostgreSQL or BigQuery?
Yes. I can extract data from APIs and load it into your preferred destination.
Can you build Apache Airflow DAGs?
Yes. I can build scheduled DAGs with task dependencies, error handling and logging.
Do you support dbt?
Yes. I can create SQL transformations and basic data quality tests.
Can you fix an existing ETL pipeline?
Yes. Please send me a description of the problem before ordering.
Is cloud infrastructure included?
Cloud infrastructure and hosting costs are separate. I can provide deployment assistance under a custom scope.
