Browse categories
Explore
Fiverr Pro
English
$
USD
I will develop spring kafka consumer pipeline
Abdul Q
About this gig
Are you looking for data engineer to help you with big data projects, pipelines or analytics? You are in the right place. I am professional big data engineer experienced in Hadoop, Spark, Kafka, Hive, PySpark and Scala.
I will develop your kafka pipeline consumer with retry mechanism, custom consumer configuration(scalable), CRUD operation.
Get to know Abdul Q
Abdul Q
Computer Engineer
- FromPakistan
- Member sinceJan 2025
- Avg. response time12 hours
- Last delivery1 year
Languages
Urdu, English, Punjabi
As a Python automation specialist with over many years of experience, I specialize in creating efficient, scalable solutions to simplify workflows and enhance productivity. My expertise includes Machine Learning, data scraping, Model training, and custom scripting for web, mobile, and desktop environments. With a commitment to delivering clean, maintainable code and tailored solutions, I help businesses save time, reduce errors, and achieve their goals. Let’s work together to bring your ideas to life
FAQ
Can I test this locally?
Absolutely. Everything is fully Dockerized. You only need Docker installed, no manual setup or Python config needed.
Does it save summaries to HDFS?
By default, summaries are logged to console. If you’d like to store them, I can modify the logic. Just ask.
What big data technologies do you use in your data engineering projects?
I work with industry-leading big data tools including Hadoop, Spark, Kafka, Hive, and PySpark. These technologies allow me to design scalable data engineering solutions, build efficient data pipelines, and process large datasets for analytics.
What types of data engineering services do you offer?
I offer a wide range of data engineering services including ETL development, big data processing, Hadoop cluster setup, Spark optimization, Kafka integration, and data analytics solutions
