I will do professional data engineering etl creation
AWS GCP PYTHON Data Engineering
About this Gig
Cloud-Based ETL Developer (AWS + GCP) | Data Pipelines | Automation | Big Data
Are you looking for a reliable cloud ETL developer to build, automate, or optimize your data pipelines across AWS or Google Cloud?
I help companies design scalable, cost-optimized, and production-ready ETL workflows using modern cloud-native tools.
What I Can Do for You
Build end-to-end ETL/ELT pipelines (batch or streaming)
Migrate on-prem ETL jobs to AWS / GCP
Integrate APIs, databases, data lakes, SaaS tools
Transform & clean data using Python, SQL, dbt, Pandas
Orchestrate workflows using Airflow / Cloud Composer / Step Functions
Develop streaming pipelines using Pub/Sub / Kinesis
Create serverless ETL using Lambda / Cloud Functions
Build Data Lakehouse solutions using BigQuery / Redshift / Athena
CI/CD for ETL (GitHub Actions, Cloud Build, CodePipeline)
Cloud Stack I Work With
AWS
- AWS Glue, Lambda, Step Functions
- S3, Redshift, Athena, EMR
- API Gateway, EventBridge
- DynamoDB, RDS, Aurora
GCP
- Cloud Composer (Airflow)
- Cloud Functions, Cloud Run
- Cloud Storage
- Pub/Sub
Deliverables You Will Receive
- Production-ready ETL pipeline
Technology:
Apache Spark
•
Python
•
SQL
•
Snowflake
•
NoSQL
•
Apache Airflow
