Webscaper / searcher
Description
I collect a fountainpens and there are many sites on the internet that sell them.
i need an intelligent webscraper / internet crawler that gathers all the listings into a system for me which i can access via simple web interface.
i can provide a list of known sites i need to scrape (these include all of the vinted sites as well as global craigslists, FB Market place, ebay as well as various other niche sites)
the system should have a daily as well as 3 day archive so that it refreshes at 00:00CET every day and scans for new listings every few hours or at least twice a day.
the system needs to remove duplicate listings as well as those listings which are historic and sold
this needs to be completed in a couple of days.
Budget: GBP 650 (Fixed Price)
Proposals: 67 freelancers have applied