I will build and optimize etl data pipelines on AWS or azure using pyspark

Mukund M

India

I speak English, Russian, French, German

AWS and Azure Data Engineer for PySpark, ETL and Data Pipelines

Data Engineer with nearly 5 years building production pipelines on AWS and Azure, currently at a SEBI-regulated fintech. AWS Certified Data Engineer - Associate. I build and fix ETL/ELT pipelines wit...
Read More
About this Gig

Need reliable data pipelines without hiring a full-time engineer?


I'm a Data Engineer with nearly 5 years on AWS and Azure, currently in a regulated fintech. AWS Certified Data Engineer - Associate.


What I can do for you:

  • Build ETL/ELT pipelines with PySpark, Python and SQL
  • - AWS: Glue, Lambda, S3, Redshift, Athena
  • - Azure: Data Factory, Synapse, Databricks, plus Snowflake
  • - Migrate data from legacy systems or files into a cloud warehouse
  • - Speed up slow queries and pipelines (I have delivered 30-40% gains)
  • - Add data-quality checks so bad data never reaches your reports
  • - Orchestrate with Airflow or ADF

How we work: you share access or sample data, I send a short plan, build it, and hand over working code plus documentation.


Please message me before ordering so I can confirm scope.

Read More
build and optimize etl data pipelines on AWS or azure using pyspark
Full Screen
build and optimize etl data pipelines on AWS or azure using pyspark

Destination Platform:

Snowflake

•

Amazon Redshift

+3 more

Tools & Platforms:

Azure Data Factory

•

Other

Related tags