How do I find out what causes my 404 Page Errors?

[DanielCoe]

Tweet

Hi,

I get a number of hits, or should I say 404 Page errors on one of my sites, but it has so many pages I cannot find out why the 404 Page Errors are happening.

I have just installed AWstats and downloaded the Apache log file, but it only came up with 1 404 error - I know this is not true.

Can anybody tell me the best way to find out what causes my 404 Page Errors?

Or how do I get the info on the page name the person tried to reach before they landed on my 404 page?

Thanks

Daniel

[John]

Run Link Sleuth (http://home.snafu.de/tilman/xenulink.html) on your site - That should identify any links to dead pages.

[Mogga]

I have awstats on one of my sites and theres a bit at the bottom - 404 Document Not Found - the 404 is a link to a list of pages looked for...

However I have some very strange referrer errors which I haven't worked out yet -
Although I get a lot for robots.txt - but Should I ignore that or try out the idea of ftping a blank txt document for that.

[DanielCoe]

Hey,

That was the AWstats report I ran, but it only gave me 1 404 Page Error.

I have downloaded Xenu - I'm now running it - Thanks.

Dan

[Brendon]

>> Although I get a lot for robots.txt

Just upload a blank one. It'll cull those 404 errors, and slightly reduce your bandwidth loading as a side bonus (the standard 404 return is 512 bytes. A blank 200 should be less)