/    Sign up×
Community /Pin to ProfileBookmark

Scan Entire Website and Get List of Pages?

Copy linkTweet thisAlerts:
Jan 07.2015

Hello,

I’m looking for a tool that scans an entire website and returns a list of all the pages (including ones that are hidden by search engines). I’m going through a site migration project and need to make sure I identify everything out there so that it can be moved.

I keep coming across programs called “link checkers,” but they don’t seem to be exactly what I’m looking for.

Any advice would be great!

Thanks!

to post a comment
Full-stack Developer

1 Comments(s) ↴

Copy linkTweet thisAlerts:
@nap0leonJan 07.2015 — Used this one in the early 2002 and again just a couple years ago.

http://sbl.net/

You may be able to get by with the free version, but it is inexpensive and will give you more options and controls.
×

Success!

Help @cbVision spread the word by sharing this article on Twitter...

Tweet This
Sign in
Forgot password?
Sign in with TwitchSign in with GithubCreate Account
about: ({
version: 0.1.9 — BETA 6.16,
whats_new: community page,
up_next: more Davinci•003 tasks,
coming_soon: events calendar,
social: @webDeveloperHQ
});

legal: ({
terms: of use,
privacy: policy
});
changelog: (
version: 0.1.9,
notes: added community page

version: 0.1.8,
notes: added Davinci•003

version: 0.1.7,
notes: upvote answers to bounties

version: 0.1.6,
notes: article editor refresh
)...
recent_tips: (
tipper: @nearjob,
tipped: article
amount: 1000 SATS,

tipper: @meenaratha,
tipped: article
amount: 1000 SATS,

tipper: @meenaratha,
tipped: article
amount: 1000 SATS,
)...