I will build a python API ingestion pipeline into postgresql

Brazil

I speak English

Data Engineer and Python Developer

I am a Python Data Engineer specializing in automated data ingestion pipelines, API integrations, and PostgreSQL optimization. I help businesses eliminate fragile manual spreadsheets and broken data ...
About this Gig

Stop wasting hours on daily manual CSV exports from ERPs or fixing dashboards that break when APIs rate-limit or time out.


I will build a resilient Python data ingestion engine for up to 3 REST API endpoints, delivering clean, duplicate-free incremental loads directly into PostgreSQL or Parquet.


What is included in every delivery:

- Python ingestion pipeline with rate-limit handling, auto-pagination, and exponential retries

- Duplicate-free incremental loads into PostgreSQL or Parquet

- Execution audit table (pipeline_runs_audit) to track every pipeline run

- Containerized Docker Compose deployment with automated scheduling

- Step-by-step operations runbook and setup documentation


How we work:

1. Quick tech diagnostic to review your API endpoints and target schema

2. Fixed scope and clear delivery timeline

3. Tested Docker Compose deployment with live audit logs


Proven architecture based on production engineering patterns (comex-data-engine-v2).


Message me with your API docs or ERP source before ordering so we can align on your endpoints and schema.

Destination Platform:

Snowflake

•

Databricks Lakehouse

•

PostgreSQL

Tools & Platforms:

Other

My Portfolio

Other Data Engineering Services I Offer