/    Sign up×
Community /Pin to ProfileBookmark

robots.txt? DTD declaration?

ok, i have seen it said on a site or maybe two:

use a robots.txt file instead
Use the DTD declaration instead

what is robots.txt? and what is DTD declaration? thx

to post a comment
SEO

2 Comments(s)

Copy linkTweet thisAlerts:
@AdamGundryAug 15.2004 — A robots.txt file gives instructions to search engine robots - check out http://www.robotstxt.org/

A document type declarartion (AKA doctype or DTD) specfies which version of (X)HTML your site uses. See http://www.alistapart.com/articles/doctype/

Adam
Copy linkTweet thisAlerts:
@pawkyauthorAug 15.2004 — oh, doctype. ok, i was just going to be reading the site u listed today sometime. thx ? and also now to read robotstxt.org. thx for the help ?
×

Success!

Help @pawky spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 BETA 5.19,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @AriseFacilitySolutions09,
tipped: article
amount: 1000 SATS,

tipper: @Yussuf4331,
tipped: article
amount: 1000 SATS,

tipper: @darkwebsites540,
tipped: article
amount: 10 SATS,
)...