I will build automated etl data pipelines

Pakistan

I speak Urdu, English

Data Engineer

I am a data engineer with 3+ years of experience delivering end-to-end data solutions on cloud platforms like Microsoft Azure. I specialize in building ETL/ELT pipelines and dimensional models using P...
About this Gig

Need data from websites, or have data but no reliable system moving it? Spreadsheets, APIs and databases that never line up, reports rebuilt by hand every week, pipelines that break overnight? I fix that.

Im a Data Engineer with 4 years of experience and an MSc in Big Data Analytics from the UK. I currently build production pipelines for large online marketplaces, including incremental Redshift fact tables over 20M+ records.

What I build:

  • Web scraping with BeautifulSoup, Requests, Selenium, Scrapy and Playwright, feeding website data straight into your pipeline
  • ETL/ELT pipelines in Python, PySpark, SQL and Airflow
  • Incremental loads so only new data gets processed
  • Warehouse loading into Redshift, BigQuery or Azure
  • Schema-mismatch handling with AWS Lambda, so pipelines dont fail silently
  • Data quality fixes for duplicate and missing records
  • Power BI / Microsoft Fabric dashboards on your clean data

Why me: real production experience, clean documented code that you own, and clear updates at every step.

Please message me before ordering so I can scope your project properly.

Langugae:

English

Technical expertise:

dbt (Data Build Tool)

•

Matillion

Expertise:

Data Pipelines

•

ETL Development

•

Data Warehousing

Industry:

Data analytics

•

Marketing & advertising