Affiliate Marketing
Forum Search

Reply
 
LinkBack Thread Tools Display Modes

  #1 (permalink)  
Old 14-09-06
Registered User
 
Join Date: Oct 2005
Posts: 426
Thanks: 0
Thanked 0 Times in 0 Posts
Nosmo_King is an unknown quantity at this point
  Restrict Search Engine Spider

I've got a php file which called by an include from the main page.

What's the best way to stop this being spidered?
__________________
Travel Domains for sale: luxuryhotelparis.co.uk italytravelguide.co.uk bettertravel.co.uk america-flights.co.uk bargainairline.co.uk costaricahotel.co.uk hotelsintallinn.co.uk
Pm me for prices.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 14-09-06
uklejon's Avatar
Registered User
 
Join Date: Aug 2003
Location: Shropshire
Posts: 815
Thanks: 0
Thanked 0 Times in 0 Posts
uklejon is an unknown quantity at this point
It shouldn't get spidered on its own as its inculded at server-side level.

The only way to get the contents of this page not spidered would be to disallow the pages its included in. ie. the main page!

Jon
__________________
Jon

UK Link Exchange - Find Link Exchange Partners
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 14-09-06
Registered User
 
Join Date: Mar 2004
Location: Reading, UK
Posts: 301
Thanks: 0
Thanked 0 Times in 0 Posts
dmorison is an unknown quantity at this point
If there is never an actual link to the included PHP script then strictly speaking a spider would have no knowledge of the filename and therefore never index it individually.

The content generated by the include will, of course, be indexed as part of the page the included it - there's nothing you can do about that unless you restrict crawling of the parent page via robots.txt.

If you really want to be sure; what I would do would be to put your include files into a separate directory, and then prohibit any access to that directory using .htaccess, for example, if you create your file in a subdirectory as "/includes/file.php", you could then create the following as "/includes/.htaccess":

Code:
deny from all
That would pretty much guarantee that no crawler will ever index includes/file.php on its own.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 14-09-06
Registered User
 
Join Date: Oct 2005
Posts: 426
Thanks: 0
Thanked 0 Times in 0 Posts
Nosmo_King is an unknown quantity at this point
OK... Thanks for the quick replies
__________________
Travel Domains for sale: luxuryhotelparis.co.uk italytravelguide.co.uk bettertravel.co.uk america-flights.co.uk bargainairline.co.uk costaricahotel.co.uk hotelsintallinn.co.uk
Pm me for prices.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Sponsored Links
  #5 (permalink)  
Old 14-09-06
anshul123's Avatar
Registered User
 
Join Date: Jun 2006
Location: Bangalore
Posts: 533
Thanks: 1
Thanked 2 Times in 2 Posts
anshul123 is an unknown quantity at this point
i think there is a thing called no follow tag that you can put in html coding
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Bookmarks


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
My Keyword Research - Care to contribute to the research? webdesignhq Search Engine Strategies 4 26-03-07 09:52 AM
Search Engine Strategies Banner-Traffic Search Engine Strategies 0 10-08-06 10:51 PM
Seach Engine Optimisation FAQ [Jan2006] thetafferboy Organic Google Search Optimisation 2 09-01-06 05:11 PM
ARELIS 3 Link Popularity Software Qui Gon Jinn Website Promotion 4 05-03-03 07:34 AM


Affiliate Marketing RSS Feeds - Contact Us - Affiliate Marketing - Archive - Privacy Statement - Top

Content Relevant URLs by vBSEO 3.2.0 RC7