bandwidth

[andy_jacko]

google seems to be going mad on a customers site, its used 1.5gb of transfer in a couple of weeks,

is there a way to slow down google, or limit the ammount of time it returns or anything.


help


regards andy

[km8]

Originally posted by andy_jacko google seems to be going mad on a customers site, its used 1.5gb of transfer in a couple of weeks, is there a way to slow down google, or limit the ammount of time it returns or anything. help regards andy

1.5GB? that's about £4.

Margins must be tight in his business.

Lots of people would happily pay G**gle 10 times that to visit more often and hoover up more pages. Ask him/her how many customers he/she could send a mailing to for that price - then tell him how many visitors G**gle gets per

couple of weeks

.

I'd say, explain to your client why it is money well spend (invested might be better terminology)

I seem to recall something about Gift-horses and Mouths? - anybody know?

Yes, there is a way - ban the Googlebot in your htaccess file - course the site will drop out of the G**gle index in due course but he'll save £4 every couple of weeks.

[Mogga]

9. Googlebot is crawling my site too fast.

Please send an email to googlebot@google.com with the name of your site and a detailed description of the problem. Please also include a portion of the weblog that shows Google accesses, so we can track down the problem more quickly on our end.

from
http://www.google.co.uk/intl/en/webmasters/3.html#B9

[lowndsy]

I agree - if your server can take it let it do its thang, unless it is chewing up all that bandwidth on just a handful of pages - if the googlebot is getting caught in an artificial loop on your site it will eat bandwidth like nobodies business and there is even a chance (albeit very slim) that the precautions put in place to stop the very old scam of looping pages together to increase PR will kick in, penalising your site or worse.

[andy_jacko]

i know google visiting is a good thing

but the site is an oscommerce site with just over 100 products. 1.5gb of transfer seems more like being stuck in a loop than genuine visits.

not too worry, the bandwidth isnt the problem, as you say £4 for transfer isnt a lot, so i'll keep monitoring it.

also last check the google bot had visited the chekout page for a few products and had a backet for £115 someone get that bot a credit card


regards andy