I will do data engineering projects, databases, extraction, etl

India

I speak English

Data Engineer

I am a Data Engineering enthusiast with experience in building real-time pipelines and optimizing Spark jobs. I have interned at Airtel Digital and Grant Thornton, where I specialized in Apache Pinot,...
About this Gig

Imagine having a data pipeline that seamlessly extracts data from multiple sources, cleans and transforms it, and delivers reliable, analysis-ready data. That's where I can help! With hands-on experience in data engineering at Airtel Digital and Grant Thornton Bharat, I can help you build efficient data pipelines, optimize data processing, and automate workflows tailored to your business needs.

My Skills:

  • Strong proficiency in Python, SQL, PySpark, and Spark SQL
  • Experience with Apache Spark, Databricks, and Delta Lake
  • Hands-on experience with Apache Kafka and real-time data streaming
  • Experience building ETL pipelines, incremental data loads, and data deduplication frameworks
  • Knowledge of Google Cloud Platform, Google Cloud Storage, and BigQuery
  • Experience with Spark performance tuning and SQL query optimization
  • Understanding of data warehousing, data modeling, and data quality
  • Strong problem-solving and analytical skills

What I Do:

  • Data Engineering: Build and optimize ETL pipelines using Python, SQL, and PySpark.
  • Data Cleaning & Transformation: Clean, validate, and transform raw data into structured, analysis-ready datasets.
  • Pipeline Automation: Automate repetitive data processing

Langugae:

English

Technical expertise:

dbt (Data Build Tool)

•

Apache Airflow

Expertise:

Data Pipelines

•

ETL Development

•

Data Warehousing

Industry:

Data analytics

My Portfolio