/    Sign up×
Community /Pin to ProfileBookmark

*** Newbie *** Site spidering tools? Any recomendations?

Copy linkTweet thisAlerts:
Feb 08.2006

Hi All,

Newbie here! I’m after a little help from people in the know and this looks like a rather good place to start ?

I’m in the process of migrating a rather large website. I have a number of smaller websites that currently link into the main site. The links hook in at various points (Alas it’s not just Root).

Rather than do a massive amount of Dev to update the links, i’d like to set-up redirects from the smaller sites that plug in.

Is there some kind of spidering tool i can unleash on my sites to tell me:

  • – The URL or File Name of the page that has an outward link to the main site

  • – The destination of the url thats spidered

    • I’ve seen various, web based tools that can spider a site but unfortunatly none of my sites are in the public domain (They’re intranets). So, i guess i need an app that i can deploy on the servers?

    Any help would be much appreciated!

    Thanks in advance!

    Rich

    to post a comment
    SEO

    2 Comments(s) ↴

    Copy linkTweet thisAlerts:
    @pcthugFeb 11.2006 — [URL]http://www.tipue.com/products/endsheet/[/URL]
    Copy linkTweet thisAlerts:
    @LeeUFeb 13.2006 — Try this also:

    [URL=http://johannesmueller.com/gs/]http://johannesmueller.com/gs/[/URL]
    ×

    Success!

    Help @Rich_G spread the word by sharing this article on Twitter...

    Tweet This
    Sign in
    Forgot password?
    Sign in with TwitchSign in with GithubCreate Account
    about: ({
    version: 0.1.9 — BETA 5.23,
    whats_new: community page,
    up_next: more Davinci•003 tasks,
    coming_soon: events calendar,
    social: @webDeveloperHQ
    });

    legal: ({
    terms: of use,
    privacy: policy
    });
    changelog: (
    version: 0.1.9,
    notes: added community page

    version: 0.1.8,
    notes: added Davinci•003

    version: 0.1.7,
    notes: upvote answers to bounties

    version: 0.1.6,
    notes: article editor refresh
    )...
    recent_tips: (
    tipper: @AriseFacilitySolutions09,
    tipped: article
    amount: 1000 SATS,

    tipper: @Yussuf4331,
    tipped: article
    amount: 1000 SATS,

    tipper: @darkwebsites540,
    tipped: article
    amount: 10 SATS,
    )...