I will build an automated etl pipeline with airflow and postgresql
Data Engineer
About this Gig
Stop manually copying data between sources. I build automated ETL pipelines that fetch data from APIs or websites, clean and validate it, and load it into your database with zero manual work after setup.
What you get:
- Data fetched from your source(s) API or website
- Cleaning and validation before anything touches your database
- Storage in PostgreSQL (or your preferred SQL database)
- Optional: scheduled runs with Apache Airflow (daily/weekly/custom)
- Optional: full history tracking, not just the latest snapshot
- Optional: automated alerts (Telegram/email) when new data arrives
I recently built a production-style pipeline on this exact stack Airflow, PostgreSQL, Docker pulling data from multiple sources, normalizing it into one clean schema, and tracking every record's history. I'll share the GitHub repo so you can review the code quality before you order.
Every pipeline is built around your actual data source and database not a generic template with your name pasted on it.
Message me your data source and target database before ordering so I can confirm scope and timeline.
Technology:
Python
•
SQL
•
Apache Airflow

