I will build a production gcp data pipeline with bigquery and dataflow

Pakistan

I speak Urdu, Hindi, English

63 orders completed

dataops engineer

Hello! I'm Muhammad Touseef, a seasoned professional in cloud security, Linux, AWS, DevOps, SEO, web development, and digital marketing. With over 5 years of experience, I specialize in crafting tailo...
About this Gig

Your data pipeline is slow, expensive, or breaks silently and you're tired of debugging it at midnight.


I build production-grade GCP pipelines that process 10TB+ daily without breaking a sweat.


WHAT I'VE BUILT:

26TB ClickHouse cluster (136B rows, 14ms queries)

Real-time Kafka Go ClickHouse ingestion

GCP pipelines: Cloud Function Pub/Sub Dataflow BigQuery

BigQuery partition + cluster optimization (80% cost reduction)


WHAT YOU GET:

End-to-end GCP pipeline (Cloud Storage Dataflow BigQuery)

Serverless compute (Cloud Run / Cloud Functions)

Python + SQL production code

Monitoring, error handling, DLQ

Documentation + 30-min handover call


WHY ME:

I don't just write code I own reliability

Production experience, not tutorial experience

I'll tell you what NOT to do (saves you money)


Let's build a pipeline that actually works. Message me before ordering.

Technology:

Amazon Redshift

•

Apache Cassandra

•

Apache Kafka

Expertise:

API integration

•

Clustering

•

Data extraction