I will build scalable data pipelines with spark or pyspark

India

I speak Hindi, English

10 orders completed

Data Engineer with 5+ years of experience building scalable ETL pipelines and real-time data processing systems. I specialize in Spark, PySpark, Kafka, Scala, and cloud data platforms on GCP and Azure...
About this Gig

Are you struggling with large-scale data processing or slow ETL pipelines?


I am a Data Engineer with 5+ years of experience building high-performance data pipelines for fintech systems processing millions of transactions daily.


I can help you design, build, and optimize scalable data pipelines using modern big data technologies.


Services I offer:

Build ETL pipelines using Spark / PySpark

Kafka streaming pipelines

Batch and real-time data processing

Data pipeline optimization

Data ingestion from APIs, databases, or files

Data warehouse integration


Technologies:

Spark | PySpark | Kafka | Scala | Hive | BigQuery | BigTable | SQL | GCP | Azure


Why choose me?

Production-grade pipelines

Optimized for large datasets

Clean, scalable code

Fast communication

Langugae:

English

Hindi

Technical expertise:

dbt (Data Build Tool)

Apache Spark

Hadoop

Expertise:

Data Pipelines

ETL Development

Data Warehousing

Industry:

Data analytics

Financial services

Food & beverage