I will build etl and elt data pipelines with python, sql and dbt
Data Engineer for ETL and ELT Pipelines, SQL, Python, dbt, Databricks
About this Gig
Need reliable data pipelines that turn raw data into clean, analysis-ready tables? I'm a Data Engineer (Top Rated on Upwork, 100% Job Success, 1,000+ hours) and I build ETL/ELT pipelines that are tested, documented and easy to maintain.
WHAT YOU GET
- ETL/ELT pipelines in Python and SQL from APIs, databases, files and cloud storage
- Data warehouse modeling with dbt (staging, intermediate and mart layers)
- Orchestration with Apache Airflow, containerized with Docker
- Lakehouse pipelines on Databricks, PySpark and Delta Lake
- SQL query optimization and data quality checks
- Clear documentation and a handover call
MY PROCESS
- Short discovery chat about your sources, volumes and goals
- Agree the pipeline design
- Build, test and validate against your data
- Deliver code, docs and a walkthrough
Not sure which package fits? Message me before ordering and I will recommend the right scope.
My Portfolio
FAQ
Which tools and platforms do you work with?
Python, SQL, dbt, Apache Airflow, PySpark and Databricks, with Postgres and other relational databases. I also integrate APIs, flat files and cloud storage. Tell me your stack and I will work with it.
What do I receive at delivery?
Well-commented source code, a short README with setup and run steps, and a walkthrough of how the pipeline works. Standard and Premium also include an initial data audit and design recommendations.
