I will build automated etl data pipelines
Data Engineer
About this Gig
Need data from websites, or have data but no reliable system moving it? Spreadsheets, APIs and databases that never line up, reports rebuilt by hand every week, pipelines that break overnight? I fix that.
Im a Data Engineer with 4 years of experience and an MSc in Big Data Analytics from the UK. I currently build production pipelines for large online marketplaces, including incremental Redshift fact tables over 20M+ records.
What I build:
- Web scraping with BeautifulSoup, Requests, Selenium, Scrapy and Playwright, feeding website data straight into your pipeline
- ETL/ELT pipelines in Python, PySpark, SQL and Airflow
- Incremental loads so only new data gets processed
- Warehouse loading into Redshift, BigQuery or Azure
- Schema-mismatch handling with AWS Lambda, so pipelines dont fail silently
- Data quality fixes for duplicate and missing records
- Power BI / Microsoft Fabric dashboards on your clean data
Why me: real production experience, clean documented code that you own, and clear updates at every step.
Please message me before ordering so I can scope your project properly.
FAQ
Which tools do you work with?
Python, SQL, PySpark, Apache Airflow, Matillion, Talend, AWS (Redshift, Lambda), Azure, Google BigQuery and Power BI, plus BeautifulSoup, Requests, Selenium, Scrapy and Playwright for web scraping.
Can you scrape websites that load content with JavaScript?
Yes. For dynamic sites I use browser automation tools like Selenium or Playwright instead of simple page requests.
Can you work with my existing pipeline?
Yes. I can debug, optimize or extend pipelines you already have, including fixing duplicate or missing records.
In what format will I get my data?
CSV, Excel, JSON, Google Sheets, or loaded directly into your database or data warehouse.
Do I own the code?
Yes. You get the full source code, and Standard and Premium also include documentation.
Do you scrape any website?
I scrape publicly available data only. I don’t scrape social media or anything behind a login without permission, as this goes against Fiverr’s rules.
Can you build real-time pipelines?
Scheduled batch pipelines are my core offer. For real-time needs, message me first and we’ll check whether it fits.

