I will build or optimize python data pipelines on gcp or AWS

Dovy

United States

I speak English, Japanese
Accomplished technology executive with expertise in cloud-native distributed systems, large-scale data architectures, and AWS/GCP platform modernization. Proven in designing high-throughput systems th...
Read More
About this Gig

Drawing from rebuilding platforms in Python/Apache Beam (reducing 10K+ lines to 2K while handling 1B+ rows/month), I'll create custom ingestion, processing, and automation pipelines. Handle high-volume data, fix financial rounding issues, and integrate fail-safes for resilient operations. Ideal for analytics, ETL, or real-time streaming needs.

Read More
build or optimize python data pipelines on gcp or AWS
Full Screen
build or optimize python data pipelines on gcp or AWS
Full Screen
build or optimize python data pipelines on gcp or AWSbuild or optimize python data pipelines on gcp or AWS

Tools:

Docker

•

GitHub

•

CircleCI

•

Cloud Formation

+3 more

Frameworks:

Npm

•

Terraform

•

Other

Cloud Provider:

Amazon Web Services

•

Google Cloud Platform

Programming language:

Python

•

Java

•

JavaScript

•

PHP

•

Bash

Expertise:

Migration

•

Debugging

•

Development

Related tags