I will develop databricks data pipeline, etl, analytics dashboard, spark sql python

India

I speak English

Data Engineering, R Shiny, Data Pipelines, DBt, Databricks, Snowflake

Data engineering specialist with deep expertise in R, R Shiny, Snowflake, dbt, and Databricks. I design and build custom data pipelines that transform raw data into actionable business insights. My se...
About this Gig

Looking to harness the full power of your data using Databricks? I provide expert Databricks solutions for data engineering, ETL pipelines, analytics dashboards, and workflow automation for all businesses.


With 4+ years as a data engineer, I specialize in:

- Setting up secure Databricks workspaces and clusters from scratch

- Connecting multiple data sources: cloud storage, databases, APIs, CSV/Excel

- Building robust ETL and ELT pipelines for automated data ingestion and transformation

- Data cleansing, formatting, and preparing large datasets for reporting and analytics

- Implementing advanced analytics using Spark SQL, PySpark, and Python automation

- Designing interactive data dashboards and automated reporting solutions

- Data warehouse and data lake architecture design with optimization

- Delivering well-documented, production-ready code with comprehensive guides


Why work with me?

- Extensive experience with Databricks, Apache Spark, and big data technologies

- Proven track record in enterprise-scale data engineering projects

- Fast response and clear communication

- Strong commitment to data security, privacy, and compliance

- Post-delivery support

Langugae:

English

Technical expertise:

dbt (Data Build Tool)

Apache Spark

Expertise:

Data Pipelines

Data Warehousing

Data Lake Setup

Industry:

Biotech

Data analytics

Financial services

Other