Browse categories
Explore
Fiverr Pro
English
$
USD
I will build real time data streaming pipelines using kafka, spark and python
Big data engineer
I’m a curious individual who loves learning, building, and simplifying complex systems using data and AI.
I work as a full-time Big Data Engineer, designing and automating pipelines that turn messy, ...
Level 1
Has met certain performance criteria and shows strong potential in the marketplace.
About this Gig
Modern applications generate massive real-time data streams from websites, mobile apps, IoT devices, and cloud platforms. Processing this data efficiently requires scalable streaming architectures and reliable data pipelines.
I am a Data Engineer specializing in big data systems and real-time processing, and I will help you design and implement high-performance streaming pipelines using technologies like Apache Kafka and Apache Spark.
I have experience building distributed data systems and large-scale analytics pipelines, including a real-time music recommendation system that processed 100GB+ of streaming data using Hadoop and Spark, and real-time ETL pipelines with data warehousing for enterprise analytics.
Technologies
- Apache Kafka
- Apache Spark / Spark Streaming
- Python / PySpark
- Scala
- AWS / Azure
Example Use Cases
- Real-time website analytics
- Financial transaction processing
- IoT sensor data pipelines
- Real-time recommendation engines
I focus on building scalable, reliable, and production-ready streaming pipelines that turn live data into actionable insights.
Contact me before placing an order to discuss your requirements.
