/    Sign up×
Community /Pin to ProfileBookmark

Detecting Robots

Copy linkTweet thisAlerts:
Apr 13.2008

I need to detect whether a page is being visisted by a robot / web crawler or a human.

Any suggestions?

Thanks
CTB

to post a comment
PHP

2 Comments(s) ↴

Copy linkTweet thisAlerts:
@LiLcRaZyFuZzYApr 13.2008 — I never tried this, but i would use the user-agent-string.info API:

http://user-agent-string.info/api

In the example you can see there is a type property in the answer which give back:
[CODE]"crawler"
"browser"
"offline browser"
"user agent anonymizer"[/CODE]
Copy linkTweet thisAlerts:
@chestertbauthorApr 14.2008 — Thanks lilcraztfuzzy.

It occurred to me that maybe this might be simpler... do crawlers accept cookies?

CTB
×

Success!

Help @chestertb spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 — BETA 5.18,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...