Google Deep Crawl

getvisible · 20-10-03

Googlebot read over 2k pages of one of my sites on Saturday (18th) - did she do the same to any of your sites on that day?

Just wondering as other sites I have had only a moderate visitation.

chrisk999 · 20-10-03

I had double the normal number of pages read by googebot on the 17th October, if that helps. Back to normal on the 18th tho...

mikearmstrong · 21-10-03

Please, please, please, help a newcomer to SEO.

How do yuo know how many pages the googlebot has picked up?

Thanks in advance

Supercod · 21-10-03

Look in your log file, and look to see what pages the GoogleBot IP has visited.

mikearmstrong · 21-10-03

Thanks Supercod, I'll get onto my hoster.

Frostie · 22-10-03

If you use php, get an email immediately google hits each individual page

See an earlier post on what code you need to add here

The only problem is, if you have 1000s pages - get ready for loadsa emails

or limited them to the odd page here, and the odd page there.

monkeyman · 22-10-03

I included the script into the header file of a directory I have which has approx 45,000 pages.
Google zipped through 3,500 pages on the 18th October in about 3 hours!

3,500 emails later......

Didn't have a clue what was going on, when my email when berserk.

Probs best just to include into your main pages - index page and a few others.