/    Sign up×
Community /Pin to ProfileBookmark

How do price comparison websites gather there prices

Hi,
How do price comparison websites such as pricegrabber.co.uk gather price information from a variety of retailers. I am sure this is a simple question to most. Lack of experience I suppose : (

Do they use Xpath?

to post a comment
Full-stack Developer

6 Comments(s)

Copy linkTweet thisAlerts:
@chris22Jan 07.2010 — Just guessing, but I reckon they just crawl the web in the same way as Google and other search engines do, only looking for specific information (prices for goods/services).
Copy linkTweet thisAlerts:
@pbdeveloperauthorJan 07.2010 — I dont know if they do though ... Or maybe they do?
Copy linkTweet thisAlerts:
@jonmasterJan 08.2010 — Just do a google search how pricegrabber works..

someone would have penned an article
Copy linkTweet thisAlerts:
@Stephen_PhilbinJan 08.2010 — It's just a guess, but I think they'd probably contact the retailers and request (pay for?) some sort of access to the retailers' networks and data. That way they can just automatically harvest all the data they need without having to process out 99.9% of the data which would be just unwanted HTML etc.
Copy linkTweet thisAlerts:
@ruchiicooolJan 08.2010 — they use different types of calculation thats why al site have different data to show i hv seen new this type of site http://thenetinfo.com
Copy linkTweet thisAlerts:
@geek78Jan 15.2010 — I have seen one site actually crawling other shopping sites. An example is:

http://www.onewayshopping.com

I am not sure about price grabber.
×

Success!

Help @pbdeveloper spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 BETA 5.7,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...