Results 1 to 5 of 5

 

Thread: Block spider access to outlinks?

  1. #1
    Registered User

    Status
    Offline
    Join Date
    Feb 2009
    Posts
    22
    Thanks
    4
    Thanked 1 Time in 1 Post


    Is it a good idea to block bots from following outlinks?
    By outlink, I mean a redirect url on your site which goes to the affiliate network.

    Google is spending a lot of time following these on my site and I have over 1 million of them. All its getting out of them are the 301 redirects to the affiliate network.

    It would be better for them to spend their resources indexing the rest of my site.

    Good or bad idea to deny access to the links via robots.txt?
    Wouldn't want do damage to rankings by trying to hide things.

    Thanks!

  2. #2
    Registered User

    Status
    Offline
    Join Date
    Jun 2007
    Posts
    532
    Thanks
    4
    Thanked 27 Times in 26 Posts
    Ever since I started using redirects I have had a robots.txt disallowing redirect.php, however, I am not sure if using the robots.txt would have a detrimental affect if these links are already indexed.

    I would wait for more advice but I would certainly use the robots.txt so that Google knows that your actual site is the most important thing to be crawling and not your affiliate links.

  3. The Following User Says Thank You to warren_p For This Useful Post:

    Harvester-of-Sorrow (30-09-09)

  4. #3
    Registered User

    Status
    Offline
    Join Date
    Dec 2007
    Posts
    15
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Have you tried the rel="nofollow" attribute?

  5. #4
    Negative SEO is fun!

    Status
    Offline
    Join Date
    Sep 2003
    Posts
    1,389
    Thanks
    0
    Thanked 39 Times in 35 Posts
    >> Have you tried the rel="nofollow" attribute?

    Um, thats not how it works. Let Google see whats there, and make their own decisions. Unless oyu have a pretty decent grasp of how it all works, you're more likely to do harm than good

  6. #5
    Registered User

    Status
    Offline
    Join Date
    Feb 2009
    Posts
    63
    Thanks
    0
    Thanked 2 Times in 2 Posts
    theres no point in using rel=nofollow any more as it doesnt re-use the juice, it evapourates instead meaning its actually harming your site (or at least wasting juice) that could go towards another site...

    mtt cutts advice is to drop nofollow althgether especially on internal pages.
    Free SEO Advice from markrushworth.com



Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. display: block - CSS block positioning
    By morleymouse in forum Programming
    Replies: 2
    Last Post: 28-01-07, 04:02 PM
  2. That CJ spider
    By Mogga in forum Commission Junction
    Replies: 1
    Last Post: 10-11-03, 09:47 AM
  3. CJ Spider
    By bertm in forum Commission Junction
    Replies: 5
    Last Post: 25-04-03, 09:49 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
To Top

Content Relevant URLs by vBSEO 3.5.0 RC2