I will your broken kafka pipeline, resolve consumer lag, and optimize performance

Pakistan

I speak Urdu, Hindi, English

63 orders completed

dataops engineer

Hello! I'm Muhammad Touseef, a seasoned professional in cloud security, Linux, AWS, DevOps, SEO, web development, and digital marketing. With over 5 years of experience, I specialize in crafting tailo...
About this Gig

Is your Kafka pipeline lagging, crashing, or silently losing data? I will diagnose the root cause and fix it fast usually within 24 to 48 hours.


I am a Big Data Engineer who works with Apache Kafka in production. I do not just "restart the cluster" and hope it works. I find the exact cause consumer lag, partition imbalance, rebalance storms, broker misconfiguration, or slow downstream writes and I fix it properly.


WHAT YOU GET WHEN YOU ORDER:


- Full diagnosis of your Kafka pipeline issue (producers, consumers, brokers, topics, or downstream sink)

- A targeted fix configuration change, code fix, consumer scaling, or partition strategy

- A short written report explaining what was wrong, what I changed, and how to prevent it from happening again

- Clear communication at every step


COMMON PROBLEMS I FIX:


- Consumer lag that keeps growing

- Consumers repeatedly rebalancing or crashing

- Messages getting lost or stuck in a topic

- Producer throughput drops or timeouts

- Kafka Connect or sink connector failures (including ClickHouse or database sinks)

- Topic configuration problems (partitions, retention, replication)


Technology:

Amazon Redshift

•

Apache Cassandra

•

Apache Hadoop

Expertise:

API integration

•

Clustering

•

Data acquisition

•

Data flow