I will build a python web scraping or ai automation pipeline
AI Automation and Backend Engineer, Python FastAPI RAG
About this Gig
I build data pipelines that keep working after handover, not scripts that break in a week.
What I do:
- Scrape business, product and contact data from sites and APIs (Google Places, public directories, custom sites)
- Clean it properly: phone numbers to E.164, dedupe with fuzzy matching, verify emails (MX/SMTP), drop dead records
- Store it in a real database (PostgreSQL/Supabase) with scheduled or on-demand runs
- Optional AI layer: score and qualify each record with an LLM plus a one-line reason, or extract structured data from messy text and PDFs
I use official APIs where they exist and only fall back to raw scraping when there is no API, and I tell you which is which instead of shipping something that dies on the next layout change.
Recent work: a grid-tiled lead engine that gets near-complete city coverage instead of the truncated 60 results most scrapers silently lose.
Stack: Python, httpx, BeautifulSoup, Playwright, pandas, PostgreSQL, LLM APIs.
Message me your target sites and fields before ordering so I can confirm it is doable and quote accurately.
Technology:
Scrapy
•
Selenium
•
Beautiful soup
•
Playwright
•
Pandas
Technique:
Automated

