Browse categories
Explore
Fiverr Pro
English
$
USD
I will build databricks delta lake lakehouse and medallion architecture
Jessay
About this gig
Are you looking to build a modern, scalable data lakehouse on Databricks? I will design and implement a production-ready Delta Lake Lakehouse with Medallion Architecture (Bronze, Silver, Gold layers).
With 4+ years of experience at Publicis Sapient and Alcon building enterprise data platforms, I bring deep expertise in Databricks, PySpark, and Delta Lake.
What I will build for you:
- Delta Lake setup with optimized Bronze/Silver/Gold medallion layers
- PySpark pipelines for ingestion, transformation, and aggregation
- Delta Live Tables (DLT) for declarative, auto-scaling pipelines
- Unity Catalog for fine-grained data governance and access control
- Data quality checks, schema enforcement, and ACID transactions
- ML feature store integration for machine learning workflows
- Performance tuning: Z-ordering, partitioning, and file compaction
- Automated workflows using Databricks Jobs and clusters
- Full documentation and handover
Technologies: Databricks, PySpark, Delta Lake, Delta Live Tables, Unity Catalog, Azure Data Lake Storage, Apache Spark, SQL
Message me to discuss your requirements!
Get to know Jessay
Jessay
Senior Data Engineer: AWS, Azure, Spark, ETL Pipelines and Data Architecture
- FromIndia
- Member sinceApr 2025
- Avg. response time3 hours
- Last delivery4 months
Languages
Malayalam, English
Struggling with slow pipelines or messy data? I design and build scalable ETL pipelines that deliver real results. With 5+ years on AWS and Azure, I specialize in Databricks, Apache Spark, AWS Glue, and Azure Data Factory. I have built production-grade data warehouses, optimized Spark performance, and integrated Hadoop, Hive, and HBase environments. Stack: Python, PySpark, Scala, SQL, S3, Lambda, Step Functions, Azure Data Lake Gen2, Redshift, PostgreSQL. Ready to turn your raw data into clean, actionable insights.
My Portfolio
FAQ
What cloud platforms do you support for Delta Lake?
I primarily work with Azure Databricks and Azure Data Lake Storage (ADLS Gen2), but also support AWS (S3 + EMR/Glue) and GCP (BigQuery + Dataproc). All packages include cloud-agnostic Delta Lake configuration.
Do I need an existing Databricks workspace to get started?
Not necessarily. I can help you set up a new Databricks workspace from scratch on your cloud account, or work within your existing environment. Just share your current setup when you reach out.
