Browse categories
Explore
Fiverr Pro
English
$
USD
I will build automated etl pipelines using python airflow and sql
Data Engineer, Python and SQL Developer, Automation Expert
Hi! I am a Software Engineer specializing in Data Engineering. I help businesses organize their data, automate routine tasks, and build reliable data pipelines.
My expertise includes:
Data Processin...
About this Gig
Professional Data Engineering & Automated ETL Solutions
Are you looking for a reliable way to automate your data flows? I am a Software Engineer (Specialized in Data Engineering) dedicated to building high-performance systems that turn raw data into structured, actionable assets.
What I offer:
- End-to-End ETL/ELT: Fully automated pipelines using Apache Airflow.
- Modern Data Lakehouse: Implementing Medallion Architecture (Bronze, Silver, Gold) with PostgreSQL, dbt, and MinIO.
- Real-time Processing: Scalable streaming solutions using Apache Kafka and Spark.
- Data Integrity: "Zero Tolerance" systems with automated quarantine zones for corrupted data.
- Full Deployment: Everything is containerized with Docker for easy, one-click setup.
My Tech Stack:
- Languages: Python (Pandas, PySpark), SQL.
- Tools: Airflow, dbt, Spark, Kafka, Hadoop.
- Storage: PostgreSQL, MySQL, Amazon S3 (MinIO).
Why work with me? I focus on writing clean, production-ready code and providing professional Architecture Diagrams for every project. I ensure your data is accurate, partitioned for speed, and ready for analytics.
Please message me to discuss your project requirements before placing an order!
My Portfolio
FAQ
Do I need to provide cloud access?
Yes, to deploy the pipeline, I will need access to your environment (AWS, GCP, or a private server) or I can provide a Docker Compose file for local deployment.
Which databases do you work with?
I primarily work with PostgreSQL, MySQL, and S3-compatible storage like MinIO, but I can adapt to Snowflake or BigQuery if needed.
Will you provide documentation?
Absolutely. Every project includes clear README instructions and an architecture diagram to ensure you can manage the system easily.
