Imagine having a data pipeline that seamlessly extracts data from multiple sources, cleans and transforms it, and delivers reliable, analysis-ready data. That's where I can help! With hands-on experience in data engineering at Airtel Digital and Grant Thornton Bharat, I can help you build efficient data pipelines, optimize data processing, and automate workflows tailored to your business needs.
My Skills:
- Strong proficiency in Python, SQL, PySpark, and Spark SQL
- Experience with Apache Spark, Databricks, and Delta Lake
- Hands-on experience with Apache Kafka and real-time data streaming
- Experience building ETL pipelines, incremental data loads, and data deduplication frameworks
- Knowledge of Google Cloud Platform, Google Cloud Storage, and BigQuery
- Experience with Spark performance tuning and SQL query optimization
- Understanding of data warehousing, data modeling, and data quality
- Strong problem-solving and analytical skills
What I Do:
- Data Engineering: Build and optimize ETL pipelines using Python, SQL, and PySpark.
- Data Cleaning & Transformation: Clean, validate, and transform raw data into structured, analysis-ready datasets.
- Pipeline Automation: Automate repetitive data processing