I will design custom etl pipelines in python and sql
About this Gig
Welcome! I am a Data Engineer specializing in building robust, automated ETL/ELT pipelines using Python and SQL.
Whether you need to extract data from complex APIs or build a clean database infrastructure, I've got you covered.
What I Can Do For You:
- API & File Ingestion: Extract data from REST APIs, Webhooks, CSV, or JSON sources.
- Medallion Architecture: Structure your data into Bronze (Raw), Silver (Cleaned), and Gold (Business Ready) layers.
- Custom ETL Pipelines: Advanced data transformation, schema validation, and error handling in Python.
- Database Optimization: Design and optimize PostgreSQL, SQLite, or MySQL for high performance.
- Automation: Set up automated scripts and cron jobs for hands-off pipeline execution.
My Tech Stack:
- Language: Python (Pandas, Requests, SQLAlchemy)
- Databases: PostgreSQL, SQLite, MySQL
- Architecture: Medallion, Star/Snowflake Schema
Why Work With Me?
I design clean, maintainable, and well-documented data workflows. Every project includes code documentation and a clear architecture diagram.
Please message me before placing an order so we can discuss your specific data requirements!
Technology:
Excel
•
Python
•
SQL
•
Apache Airflow
•
Other
My Portfolio
FAQ
What databases do you work with?
I specialize in relational database design and optimization using PostgreSQL, MySQL, and SQLite. I ensure your database is structured efficiently for fast querying and clean data storage.
Can you build an ETL pipeline for any API?
Yes! As long as the API is well-documented or you can provide the access keys/endpoints, I can write custom Python scripts to securely extract, clean, and ingest that data into your destination file or database.
Do you provide documentation or code explanations?
Absolutely. Every script I deliver is cleanly commented, and I provide basic markdown documentation along with an architecture diagram so you or your team can easily maintain the pipeline.

