I will build a python etl pipeline for csv excel api and sql
Backend and Data Engineer building scalable APIs databases and ETL systems
About this Gig
If your data is too big, too messy, or too manual right now, I will automate it.
Proof: I built a pipeline processing 2+ billion rows for a financial platform, and turned a 7GB, 2,000,000+ document raw dataset into a structured, searchable data lake in two weeks, solo.
What I build:
Custom ETL pipeline (extract, clean, transform, load)
Large datasets handled without memory crashes
Resumable, idempotent pipelines
Data validation and quality checks
Loading into PostgreSQL, MySQL, or Parquet
Logging and error handling
Scheduling/automation setup
Sources: CSV, Excel, JSON, REST APIs, PostgreSQL, MySQL, SQLite, Parquet.
Send me a sample of your data and your end goal, and I will scope the pipeline before you order.
etl pipeline
python
data engineering
data cleaning
automation
Destination Platform:
Databricks Lakehouse
•
PostgreSQL
•
MySQL
•
Other
Tools & Platforms:
Kafka Connect
•
Other
My Portfolio
FAQ
How large a dataset can you handle?
I have processed 2+ billion rows using streaming/chunked techniques.
Can it run on a schedule?
es, scheduled/triggered runs included in Standard or Premium.

