Browse categories
Explore
Fiverr Pro
English
$
USD
I will collect data from any API or website into a clean database
Python data pipelines, web scraping and Excel automation
I build Python that collects data and removes manual work: API and web collectors that keep running (retries, resume after a crash, daily integrity checks), messy CSV and API data cleaned into somethi...
About this Gig
I write Python that fetches your data and keeps fetching it - from a REST API, a public endpoint, or a page that has no API at all.
What you get:
- A script you own and can run yourself, not a black box on my machine
- - Output where you need it: CSV, Excel, SQLite or your own database
- - Retries, resume after a crash, and a daily integrity check that tells you when a source went quiet
- - A short note on what the data covers and where it is unreliable, which is the part most sellers skip
I have run collectors 24/7 against exchange APIs for four sports and against crypto exchange endpoints, and processed datasets of millions of records. My code and write-ups are public on GitHub.
Before I write anything I confirm the scope in writing: sources, fields, format, schedule. If a site blocks automated access, or the data sits behind a login, I tell you before you pay, not after.
Technology:
Python
•
Excel
•
Pandas
Information type:
Currency & stocks
•
Price comparison
•
Websites
Technique:
Automated
FAQ
Will the script keep working if the website changes?
Small layout changes I fix inside the revision window. For long-term stability I recommend an API source where one exists, and I tell you before we start if a site looks fragile.
Do you scrape sites that do not allow it?
No. I check the terms of use and robots.txt first and tell you if a source is off-limits. I would rather lose the order than hand you a script that gets your account blocked.
Do I get the source code?
Yes, in every package. You get a runnable Python script and a short setup note, so you can run it yourself, change it, or hand it to your own developer later.
