I will do professional data engineering etl creation

Sri Lanka

I speak English

18 orders completed

AWS GCP PYTHON Data Engineering

I'm an experienced software developer who is having 10 years of experience in developing cloud based backend development and data engineering.
About this Gig

Cloud-Based ETL Developer (AWS + GCP) | Data Pipelines | Automation | Big Data


Are you looking for a reliable cloud ETL developer to build, automate, or optimize your data pipelines across AWS or Google Cloud?


I help companies design scalable, cost-optimized, and production-ready ETL workflows using modern cloud-native tools.


What I Can Do for You


Build end-to-end ETL/ELT pipelines (batch or streaming)

Migrate on-prem ETL jobs to AWS / GCP

Integrate APIs, databases, data lakes, SaaS tools

Transform & clean data using Python, SQL, dbt, Pandas

Orchestrate workflows using Airflow / Cloud Composer / Step Functions

Develop streaming pipelines using Pub/Sub / Kinesis

Create serverless ETL using Lambda / Cloud Functions

Build Data Lakehouse solutions using BigQuery / Redshift / Athena

CI/CD for ETL (GitHub Actions, Cloud Build, CodePipeline)


Cloud Stack I Work With

AWS

  • AWS Glue, Lambda, Step Functions
  • S3, Redshift, Athena, EMR
  • API Gateway, EventBridge
  • DynamoDB, RDS, Aurora

GCP

  • Cloud Composer (Airflow)
  • Cloud Functions, Cloud Run
  • Cloud Storage
  • Pub/Sub


Deliverables You Will Receive

  • Production-ready ETL pipeline

Expertise:

Big data

Data extraction

Data manipulation

ETL

Technology:

Apache Spark

Python

SQL

Snowflake

NoSQL

Apache Airflow