I will build a custom web scraper or automated data crawler in python
Python Web Scraping and Automation Expert, Selenium, Playwright, OCR
About this Gig
I build custom Python web scrapers and data automation pipelines that turn scattered web content into clean, structured datasets. I work with requests + BeautifulSoup for standard sites and Playwright for JavaScript-heavy or bot-protected sites (Cloudflare, dynamic content, login-gated pages).
Recently I completed a real-world project scraping 13 different oil & gas industry glossaries and reference sites handling static HTML, embedded JSON-LD data, JS-click interactions, and Cloudflare protection merging everything into one clean, deduplicated CSV dataset. You can see the full project on my GitHub.
What I can do for you:
- Scrape product listings, directories, glossaries, prices, contact info, or any structured web data
- Handle dynamic/JS-rendered pages and basic bot protection
- Merge/deduplicate data from multiple sources into one clean file
- Deliver as CSV, Excel, or JSON your choice
Send me your target site(s) before ordering so I can confirm feasibility (some sites have hard technical/legal blocks I'll flag upfront, honestly, rather than overpromise).
Technology:
Python
•
Excel
•
Selenium
•
Beautiful soup
•
Playwright
Technique:
Automated

