I will build AWS and gcp cloud data engineering etl pipelines and ml solutions
Lead Software Engineer
About this Gig
Hello! I'm a Senior Data Engineer with expertise in AWS, GCP, PySpark, ETL pipelines, cloud migration, data lakes, and ML-ready data architectures.
I help businesses build scalable, secure, and high-performance data solutions for analytics, reporting, automation, and machine learning workloads.
My expertise includes:
- AWS Glue, S3, Athena, EMR, Lambda
- GCP BigQuery, GCS, Dataflow
- PySpark, SQL, Hive, Hudi, Terraform, Apache Iceberg
- ETL/ELT pipeline development
- Cloud data migration and optimization
- ML and LLM data workflow integration
What you can expect:
- Scalable cloud-native solutions
- Optimized and cost-efficient pipelines
- Clean and production-ready code
- Clear communication and documentation
- Reliable delivery and post-delivery support
Whether you need a simple ETL workflow or an enterprise-grade cloud data platform, I can help deliver reliable and efficient solutions tailored to your business needs.
FAQ
Will my business data remain secure and confidential?
Yes. I follow strict data privacy and security best practices. Client data, credentials, and project details are never shared with third parties.
Do you sign NDAs or confidentiality agreements?
Yes, I’m comfortable working under NDAs and maintaining complete confidentiality for enterprise and startup projects.
Do you work with production cloud environments?
Yes. I have experience working with production-grade AWS and GCP data platforms, ETL pipelines, and enterprise cloud architectures.
What cloud platforms and technologies do you support?
I primarily work with AWS and GCP using technologies like PySpark, AWS Glue, BigQuery, Hive, Hudi, Terraform, Athena, and Dataflow.
Can you optimize existing ETL pipelines and reduce cloud costs?
Yes. I can analyze existing pipelines, improve performance, optimize resource usage, and help reduce cloud infrastructure costs.
Do you provide architecture diagrams and documentation?
Yes. Architecture diagrams, workflow documentation, and platform recommendations can be included based on the selected package or gig extras.

