/    Sign up×
Community /Pin to ProfileBookmark

Can one hide parts of a page from web crawlers to avoid diluting relevance rankings?

Copy linkTweet thisAlerts:
May 19.2007

Can one hide parts of a page from web crawlers to avoid their otherwise diluting the page’s relevance rankings? I have seen that Google says we can do so at least where its Adsense / Adwords crawlers are concerned, using the optimization code enclosed within the following two solid lines:

_________________________________________

<!– google_ad_section_start(weight=ignore) –>

…CONTENTS WORTH HIDING FROM CRAWLERS TO AVOID DILUTING RELEVANCE RANKINGS…

<!– google_ad_section_end –>

_________________________________________

Is there some sort of standard html coding that would work not just with Google and not just for its ad network though?

Thanks for any helpful feedback and have a refreshing weekend 🙂

to post a comment
HTML

6 Comments(s) ↴

Copy linkTweet thisAlerts:
@felgallMay 19.2007 — The Google Adsense code is JavaScript and so shouldn't appear in the HTML at all.

Move all the JavaScript into external files and all the code defining the appearance of the page into an external stylesheet and rewrite the HTML so that the tags describe what they contain and you wont have any irrelevant content in the HTML file that you want the search engines to ignore all the parts that are not relevant to the search engines will have been moved into files that the search engines don't look at.
Copy linkTweet thisAlerts:
@RichmexauthorMay 19.2007 — Good morning:

Many thanks for those sophisticated insights. You definitely seem to know your stuff. Given the high volume of pages that I have to modify though, I wonder if the more simple approach could work whereby I simply annotate in my traditional HTML that an excluded section is to be ignored by search engines. Might that be effectively possible please?
Copy linkTweet thisAlerts:
@Stephen_PhilbinMay 19.2007 — Perhaps you could have yer server side language of choice remove adverts when a search engine is detected, but then I think search engines ban sites that tailor output differently for search engines than it does for users. That and it'd still probably take an almost complete rewrite.
Copy linkTweet thisAlerts:
@RichmexauthorMay 19.2007 — Thanks for that thought. I wonder if it would be necessary to put the text & logo that I desire NOT to be crawled by search engines into some external page, and then source it over to each page where it's to nevertheless visibly appear...perhaps through objects or some other technology described at:

http://www.w3.org/TR/html401/struct/objects.html#edef-OBJECT
Copy linkTweet thisAlerts:
@CharlesMay 19.2007 — The search engines are going to follow the OBJECT or IFRAME.

No, the best solution is to use JavaScript to include the adds and as Mr. Felgal pointed out above, you'll want the script to be external just in case.

Do not, however, use JavaScript to include anything but adds.
Copy linkTweet thisAlerts:
@RichmexauthorMay 19.2007 — Thanks for the feedback. As for:

>>>Do not, however, use JavaScript to include anything but adds.<<<

Although I'm sorry that that's not an option, as the content I have in mind is not advertising (just considerably relevance rank-diluting), I am nevertheless reassured to learn that evidently what I seek is not available in the realm of simple html coding. Otherwise I would think that somebody would have posted something by now in this impressive forum which almost always amazes me. With this new dose of reality I guess we'll just have to risk our relevance rankings. A good rest of the weekend to all... ?
×

Success!

Help @Richmex spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 — BETA 5.21,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...