/    Sign up×
Community /Pin to ProfileBookmark

Creating a job search engine

Copy linkTweet thisAlerts:
Aug 10.2015

Hello everyone,

It has been a while since I’ve developed a website, more than 10 years so I am a little out of touch with new and emerging technologies. I’m starting out a side project on the side and I am wondering, how does a job site like indeed.com grab job ads from competitors. I would like the ability to grab job ads so I am not limited to jobs that employers would post exclusively on a single website.

Thanks,

Mo

to post a comment
SEO

5 Comments(s) ↴

Copy linkTweet thisAlerts:
@paddymanAug 10.2015 — Not really something i have done before, doing a quick search on indeed.co.uk the results are http://www.indeed.co.uk/jobs?q=barista&l=Leeds i suppose you would have to get access to the database or maybe or use an iframe to show the search results on the webpage itself, not sure on the legalities of just using someone elses database but if you inspect the site you will be able to find the database names and passwords might be encrypted but they will be there so find them, and call pon them in the search
Copy linkTweet thisAlerts:
@mohdhm2authorAug 10.2015 — Yeah you are right, that doesn't sound legal to me.

I was thinking more along the lines of writing a script that checks each new job ad posted within 24 hours and import the content into a database of my own, brute-force style. Only foreseeable problem is that some websites block such high activity from users, I would have to perform some sort of counter measure. The problem becomes kind of messy from that point on.

There has to be a way they are doing it legally.
Copy linkTweet thisAlerts:
@mainsqueezAug 12.2015 — Thanks for your link @.richardstevens
Copy linkTweet thisAlerts:
@Fadia_SheetalAug 13.2015 — Very useful information on this links thanks for providing us.
×

Success!

Help @mohdhm2 spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 — BETA 5.8,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...