Is google ignoring me?

[David H]

Tweet

I'm worried that my site IBS blog | Irritable bowel syndrome blog has not been google indexed.

Due to my web hosting company being complete monkeys (too long a story) my site finally got hosted but after 8 weeks of being live I suspect google hasnt indexed me. Ive done the
standard things to ensure google has indexed me like submitting the URL to google.

So my question is what is the best way to find out if google has indexed me?

[Barry]

The cache of your site from the 10 of this month looks very different

ibslog.com - Domain Names Holding Page - lowcostnames.co.uk

How long did you say you had that content on there for? If its only just been changed I would wait a little longer as the old content in the cache is just a search directory that google wont re-visit very often because its duplicate content.

Ta

[David H]

Thanks for the quick reply :-)

I went onto google webmaster tool and got this stuff..

Googlebot last successfully accessed your home page on Apr 1, 2008.
Index status:
No pages from your site are currently included in Google's index. Indexing can take time. You may find it helpful to review our information for webmasters and webmaster guidelines.
Loading...
Help
You have recently submitted one or more Sitemaps for this site. Processing Sitemaps may take some time. Check again later to see if pages from your Sitemaps are included in Google's index.

Is this good news in that Google has indexed me?

[Barry]

Google has index your site - but not yet your current content.

Sit tight for a few more days and keep adding content

Ta

[fizzbird]

You could try getting some inbound links - won't have an instant effect but will help in the long term.

BTW - you will probably find that google picks up your link from here in the next day or so.

[Mogga]

I've got a site that had a googlebot visit last may and it's never been back. Incoming links, more content and google doesn't see it still.

Other SE see it though and send it traffic - but just not google.

[Brendon]

1) Did you change the WHOIS details?

2) If you answered yes to 1), you wiped all the link data. Google doesn't like sites with no links, so go get some more

[swifty7]

On a completely separate note, can I just say, that your website is possibly one of the funniest things i have read this year, not only that, but the whole office is now reading it. Its like a pack of hyenas in here!

Thanks

Hannah

[Mogga]

1) Did you change the WHOIS details?

2) If you answered yes to 1), you wiped all the link data. Google doesn't like sites with no links, so go get some more

So does changing the whois remove any bad links?

[Barry]

Reading the 'secret diary' (on the OP's website) reminds me of a funny night I once had.

One of my mates though he had got away with flushing his skids down the bog after an unfortunate lack of bog paper, by 10.30 in the evening the pub had to close the toilets as they had unfortunately been blocked and were thus overflowing into the drinking area and making a stink. It was an early night home that evening.

Ta

[moredial]

I tried a traceroute and this is the output:

5 195.66.224.186 (195.66.224.186) 36.008 ms 32.383 ms 21.954 ms
6 83.244.255.5 (83.244.255.5) 25.271 ms 29.166 ms 24.561 ms
7 transit-i-gw2.hastwood.com (83.244.134.86) 24.363 ms 21.602 ms 26.281 ms
8 telivo-gw.cust.hastwood.net (83.244.171.178) 26.581 ms 30.005 ms 30.450 ms

After that I just have the ping rejected by firewalls

I have not been able to find any whois info on the 83.224 IP range other than the netblock 'owner'.

The browser logs show clear 200 responses for the content and no redirects in sight.

My only question relating to the browser logs is: what is squid doing?

X-Cache: HIT from localhost
Via: 1.0 localhost (squid/3.0.PRE5)
Connection: close

To explain: squid is a program which is being used by profilers like Phorm to do the nasty 307 redirects to data packets - it is how Phorm forges the profiling cookies and intercepts, to make a copy of, all your internet traffic.

I have sent a search engine bot to ibslog.com using google, msn and yahoo as useragent ID and each one was able to view the page with the correct content and did not show any redirects.

That leaves only one explanation: squid is redirecting googlebot on IP address sniffing to the advert page.

This could be happening through a router which has been hacked and has a DNS hijack malware / rootkit inserted into it. Or the host server itself could be hacked and sending whatever it is programmed to send via a back door.

David, if I were you I would contact the e-commerce section of you local police and report that you suspect an e-crime is/has being perpetrated at your hosting company and ask them to investigate. Print off the responses on this page as part of your evidence. Do it today before the compromised 'script' is removed from your host.

Good luck.

I don't recommend anyone else visit the site until the squid hijack has been removed (unless your computer is very well protected and you know how to disinfect rootkits)- new hosting highly recommended.
David, please edit your first post to add this warning for anyone who does not read down this far.

[Barry]

Well dug out moredial!!

I saw those wierd headers too and also tried a few user agents to access the page and came up with the same results - ie no change to the output html

Your closer scrutiny sounds plausible and is very interesting reading.

Ta

[moredial]

I saw those wierd headers too and also tried a few user agents to access the page and came up with the same results - ie no change to the output html

Squid is not always bad - it is a popular OS package. Here it looks like it is doing something a little more 'blackhat'. Maybe trying to get people to use PPC?

[drivetowin]

I have sent a search engine bot to ibslog.com using google, msn and yahoo as useragent ID and each one was able to view the page with the correct content and did not show any redirects.

Slightly off-topic but moredial's judgement comes into question here I think.

You criticise Phorm in other threads for planting 'spoofed' cookies yet you fraudulently set your robot to be something it isn't and that's ok - just a little hypocritical ?

One thing that as a webmaster that seriously pees me off is people who set their bot to be Google so it gets past robots.txt, swallowing up loads of bandwidth for no useful purpose when in reality they are not Google at all.

As for contacting your local police, please don't make me wet myself laughing - local plod is not going to have the first idea what to do about this, even assuming a crime is being perpetrated (which incidentally from your perspective is a very dangerous accusation to make on a public forum if you are wrong)....for one thing you haven't said where the site is hosted, it may be hosted in a country where any activity that may or may not be being conducted is perfectly legal.

[moredial]

Slightly off-topic but moredial's judgement comes into question here I think.

You criticise Phorm in other threads for planting 'spoofed' cookies yet you fraudulently set your robot to be something it isn't and that's ok - just a little hypocritical ?

I was responding to a question raised about a specific site and problems with googlebot finding the wrong content. Part of the testing was to send the bot with its own useragent and to also identify it as googlebot to see if there was any difference in content between browser view and bot view. There was not. I was hoping to see googlebot redirected via squid to the advertising content and report on where the redirect went.

How was that hypocritical?

Perhaps you can confirm that you never use any of the free web tools which show the bot's views of your pages - most offer a change of useragent option.

David
BTW - msn/live bot last crawled ibslog on 24/3/2008 and found the site not available too - no ads in the cahce. Was that before or after the site was published?
Yahoo! has no problems caching the content.