James I.Remote

Webscaper / searcher

Project-Based

Description

I collect a fountainpens and there are many sites on the internet that sell them.

i need an intelligent webscraper / internet crawler that gathers all the listings into a system for me which i can access via simple web interface.

i can provide a list of known sites i need to scrape (these include all of the vinted sites as well as global craigslists, FB Market place, ebay as well as various other niche sites)

the system should have a daily as well as 3 day archive so that it refreshes at 00:00CET every day and scans for new listings every few hours or at least twice a day.

the system needs to remove duplicate listings as well as those listings which are historic and sold

this needs to be completed in a couple of days.

Budget: GBP 650 (Fixed Price)

Proposals: 67 freelancers have applied