Backlink checker

[audiopro]

I can find all the links on my own domains but know nothing about crawling external domains.

Is anyone aware of a good resource for such information or some clues of what to search for.
Are backlinks the same as reciprocal links or are they different beasts altogether?

Keith

http://www.studiosoft.co.uk

 

[MillerH]

Not really sure what you're asking mate.

If you just want to verify all the links on a website including those to external resources, then use checkbot. Additionally you can use LWP to roll your own solution.

- Miller

 

[audiopro]

I am writing a link checker to check a local site for dead links and wondered how easy it would be to add a check for reciprocal / back links.

Keith

http://www.studiosoft.co.uk

 

[feherke]

Hi

Backlinks are incoming links to a http://en.wikipedia.org/wiki/Website]website[/url] or web page.

That means, for backlinks you have to either
[ul]
[li]crawl the site(s) which contain links to your site ( potentially to whole internet )[/li]
[li]parse your site's access log ( supposing referrers are logged )[/li]
[/ul]
So crawling your own site will not help to discover backlinks.


Feherke.

http://free.rootshell.be/~feherke/

 

[audiopro]

The only external sites I will be looking to check will already have an outgoing link from the source website.

Keith

http://www.studiosoft.co.uk

 

[feherke]

Hi

Got it. Generally there are two rules :
[ul]
[li]respect the robots.txt file and [tt]meta[/tt] [tt]robots[/tt] tags[/li]
[li]do not hit the server with frequent requests to avoid DoS[/li]
[/ul]
Sorry, I not know about any related documentation.


Feherke.

http://free.rootshell.be/~feherke/