I will build automated etl data pipeline using python, airflow and sql
Data Engineer
About this Gig
I build automated ETL pipelines that collect, process, and store data efficiently.
I extract data from APIs, files, or web sources, transform it into clean structured formats, and load it into databases for analysis. I automate workflows so your data updates without manual effort.
What I can do:
- Build end to end ETL pipelines
- Extract data from APIs, CSV, Excel, or websites
- Clean and transform raw data using Python
- Load data into MySQL, PostgreSQL, or MongoDB
- Automate workflows using cron or Airflow
- Optimize performance for large datasets
Tools:
Python, Pandas, FastAPI, Airflow, Apache Kafka , MySQL, PostgreSQL, AWS
Why choose me:
- Clean and reliable code
- Scalable solutions
- Clear communication
Contact me before placing an order.
Tools & Platforms:
Airbyte
•
AWS Glue DataBrew
•
Apache NiFi
My Portfolio
FAQ
What do you need to start?
I need your data source details, requirements, and expected output format.
Can you automate the pipeline?
Yes. I can schedule ETL jobs using cron or Airflow.
Which data sources can you handle?
APIs, CSV, Excel, databases, and web data.
Which databases do you support?
MySQL, PostgreSQL, MongoDB, and others if needed.
Can you handle large datasets?
Yes. I optimize pipelines for performance and scalability.
Do you provide revisions?
Yes. Revisions depend on the package you select.
