I will build or troubleshoot your kafka streaming data pipeline
Senior Data Engineer Big Data Architect ML AI Engineer Developer
About this Gig
I will help you design, build, troubleshoot or improve a production Kafka data pipeline.
I have extensive experience with real-time data processing and event-driven systems, including environments where data needs to be processed continuously and reliably.
I can help with:
Kafka architecture
Event ingestion
Producers and consumers
Real-time transformations
Data integration
Python-based processing
Streaming and batch integration
Error handling
Data persistence
Pipeline troubleshooting
Performance and reliability improvements
Docker/Kubernetes deployment
I can work with your existing architecture or design a new solution from the beginning.
I have worked on real-time data platforms in demanding environments including iGaming, where streaming data supported the identification of suspicious player behaviour.
For complex systems, please contact me before ordering so we can define the scope.
