I will build python etl pipelines, postgres data warehouses and apis
Data Engineer and BI Specialist
About this Gig
Stop wrestling with messy data and broken pipelines. Lets build an infrastructure you can trust.
I specialize in designing and building production-ready analytics infrastructure, from automated ETL pipelines to highly optimized Data Warehouses. Whether you need to pull data from a messy API, set up event-driven microservices, or design a PostgreSQL database with strict Row-Level Security, I deliver clean, scalable, and documented solutions.
What I can do for you:
- Custom ETL Pipelines: Automated data extraction, cleaning, and transformation using Python and PySpark.
- Data Warehousing: Designing optimized Star Schemas, handling Slowly Changing Dimensions (SCD Type 2), and implementing Materialized Views.
- Database Architecture: End-to-end PostgreSQL and Supabase setups.
- API & Event Integration: Building robust connections via REST APIs or event-driven systems using Apache Kafka and Docker.
- Business Intelligence: Preparing clean datasets ready for Power BI dashboards.
My Tech Stack: Python | PostgreSQL | Supabase | Apache Kafka | Docker | PySpark | Next.js
I don't just write scripts; I build reliable systems. Send me a message, and let's discuss your data architecture!
Technology:
Apache Kafka
•
Apache Spark
•
Python
•
SQL
•
NoSQL
