I will do web scraping and data extraction from javascript heavy sites
Gig Summary
Python Data Engineer: Web Scraping, ETL Pipelines and Data Enrichment
Level 1
Has met certain performance criteria and shows strong potential in the marketplace.
What people loved about this freelancer
hardytryer

Serbia
Excellent experience once again! The quality of the work was great, the data matched our requirements, and communication was smooth throughout the project....
hardytryer

Serbia
Great work! The data was accurate, well organized, and exactly what we needed. Communication was clear throughout the project, and despite the challenges, they...
hadleylyas923

United Kingdom
Really great to work with, made the process easy and was quick to respond and make any changes. Would definitely work with again
About this Gig
Most scraping jobs that reach me start the same way. An off-the-shelf tool hit a wall, or the last freelancer delivered a file that still needed cleaning by hand. I build web scrapers for the sites that fight back.
What I handle
- JavaScript rendering, infinite scroll, pagination, logins
- Rate limits, IP blocks and anti-bot protections, using proxies and paced requests
- Marketplaces, directories, property portals, job boards, public registries
- Scale: 600,000+ property parcels scraped and structured on one job
What lands in your inbox
- CSV, Excel, JSON, or written straight into your database
- Deduplicated and typed, against a column schema we agree before I start
- A short note on how it was built, so the pull can be repeated
- A row count, plus any fields the source turned out not to carry
What I need from you
- One page URL that already shows the data
- The fields you want, in the order you want them
- Roughly how many records, and whether this is one-off
Some sources are a bad idea and I would rather say so than take the order. Send me the link and the fields. I will tell you whether it is doable, what it costs, and where the risk is.
Technology:
Python
•
Selenium
•
Beautiful soup
•
Octoparse
•
Playwright
Technique:
Automated
My Portfolio
FAQ
Is this legal?
I scrape public pages, the kind anyone can open without an account. No paywall circumvention, and no logins unless you own the account and authorise it in writing. I read the source and its terms before quoting, and I have turned jobs down on that basis.
What if the site blocks the scraper?
That is most of what I do. Rotating proxies, real browser sessions in Playwright, human-paced timing, session and cookie handling. Heavy protection costs more time rather than getting a different answer. Send the URL and I will tell you which tier it needs.
What format do I get the data in?
CSV by default, because it opens anywhere. Excel, JSON, a Google Sheet, or a direct write into PostgreSQL, MySQL or BigQuery on request. Column names and data types are agreed before I start, so you are not renaming headers after delivery.
Can you scrape Amazon, Shopify or other online stores?
Yes. Title, price, discount, SKU, variants, stock, seller, ratings and review text. I have pulled millions of marketplace listings across TikTok Shop, Kaufland, bol.com, La Redoute and B&Q. Store catalogues are quoted by product count, not by store.
Can this run on a schedule instead of once?
Yes, though a recurring build belongs in my scraper build gig rather than this one. This gig hands you a dataset. If you want the same pull daily or weekly, landing somewhere automatically, message me and I will send you the right link.
What happens when the site changes and it breaks?
For a one-off pull it does not matter, you already have the file. For anything recurring I write selectors that survive a layout change, and add a check that alerts when a field starts coming back empty. Silent breakage is the failure worth designing against.
How many records can you handle?
Six Figures comfortably. The single job was 600,000+ property parcels from a county records system: scraped, structured, then filtered to the subset the client actually needed. Above roughly 50,000 records I quote it as a custom offer.
How long does it take?
Two days for a straightforward source at Basic size. Five when there is pagination and cleaning across several thousand records. Seven for a JavaScript-heavy or protected site at volume. I give you the date before you order and I do not quote optimistically.
Do I get the code, or just the data?
This gig delivers the data, plus a note on how it was collected so the pull can be repeated. If you want the scraper itself, with source code you own and can re-run, that is the build gig. Tell me before ordering and I will point you at it .
Can you find contact details for the companies in the list?
Yes, as an add-on. Business email, phone, website and decision-maker names, where they are publicly available. Coverage varies a lot by sector, and I will tell you what is realistic before you order rather than after. Say which fields matter and I will price it in.
19 reviews for this Gig
| (16) | ||
| (1) | ||
| (0) | ||
| (0) | ||
| (2) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
H hardytryer

Serbia
Excellent experience once again! The quality of the work was great, the data matched our requirements, and communication was smooth throughout the project. Thank you for your professionalism and dedication. Looking forward to working together again in the future.
$50-$100
Price
3 days
Duration
Helpful?H hardytryer

Serbia
Great work! The data was accurate, well organized, and exactly what we needed. Communication was clear throughout the project, and despite the challenges, they stayed committed and delivered. I would definitely recommend working with them again.
$100-$200
Price
2 weeks
Duration
Helpful?H hadleylyas923

United Kingdom
Really great to work with, made the process easy and was quick to respond and make any changes. Would definitely work with again
$50-$100
Price
7 days
Duration
Helpful?C 
craigjburton44

United States
Order Canceled
I feel the communication was good at first and a bit throughout but I was more than patient and waiting days on end for delivery. I applaud that he was trying to help think of a better way to do what I needed but he kept telling me it would be delivered "today" and nothing was ever delivered. I still...
$50
Price
5 weeks
Duration
Helpful?H hugomendonca92

Portugal
great work. thanks
$50-$100
Price
2 weeks
Duration
Helpful?
19 reviews for this Gig
| (16) | ||
| (1) | ||
| (0) | ||
| (0) | ||
| (2) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
H hardytryer

Serbia
Excellent experience once again! The quality of the work was great, the data matched our requirements, and communication was smooth throughout the project. Thank you for your professionalism and dedication. Looking forward to working together again in the future.
$50-$100
Price
3 days
Duration
Helpful?H hardytryer

Serbia
Great work! The data was accurate, well organized, and exactly what we needed. Communication was clear throughout the project, and despite the challenges, they stayed committed and delivered. I would definitely recommend working with them again.
$100-$200
Price
2 weeks
Duration
Helpful?H hadleylyas923

United Kingdom
Really great to work with, made the process easy and was quick to respond and make any changes. Would definitely work with again
$50-$100
Price
7 days
Duration
Helpful?C 
craigjburton44

United States
Order Canceled
I feel the communication was good at first and a bit throughout but I was more than patient and waiting days on end for delivery. I applaud that he was trying to help think of a better way to do what I needed but he kept telling me it would be delivered "today" and nothing was ever delivered. I still...
$50
Price
5 weeks
Duration
Helpful?H hugomendonca92

Portugal
great work. thanks
$50-$100
Price
2 weeks
Duration
Helpful?

