Results 1 to 4 of 4

 

Thread: robots.txt question

  1. #1
    Registered User

    Status
    Offline
    Join Date
    Mar 2006
    Posts
    17
    Thanks
    0
    Thanked 0 Times in 0 Posts


    I have just submitted a load of websites to be indexed to a load of search engines but when I did this I did not add the robot.txt file. Does this mean they absoultely wont be indexed by the search engines? Does this also mean that I would need to submit the websites again with the robots.txt file.

    By the way what is a .htaccess file, whats its significance do I need to ask the robots.txt file to disallow access to this.

  2. #2
    Registered User

    Status
    Offline
    Join Date
    Dec 2005
    Location
    Portsmouth
    Posts
    71
    Thanks
    0
    Thanked 0 Times in 0 Posts
    I think you will be OK and your sites will be indexed, The robots.txt file will give instructions on what content to index and what content is not allowed to be indexed. By default the bots index everything. A .htaccess file will lock the directory where the .htaccess file is located with a username and password, defined in the .htaccess file.

    Hope that is helpful
    web design and development www.breathe-tech.co.uk

  3. #3
    Super Member

    Status
    Offline
    Join Date
    Aug 2003
    Location
    Costa Del Sheffield
    Posts
    2,838
    Thanks
    5
    Thanked 18 Times in 14 Posts
    .htaccess - dont worry about it, it can be used for alsorts but I dont think you'll need it for now. and it doesnt need to be blocked, its mostly server side stuff and cant be accessed by a search engines.

    robots.txt - dont worry about it, it is just instructions for search engines, unless theres something you desperately dont want indexed you'll be okay.

    submitting sites isnt the best way to get indexed and is generally the slowest, if you can get some other sites to link to you you'll get indexed a lot faster, ask around on here for some link exchanges you might drop on someone in the same boat.
    Dan Morley
    alpharooms.com
    daniel at alpharooms dot com - Hotels, Flights, Airport Transfers, Care Hire + More! sign up
    My Blog | Cheap Holidays

  4. #4
    Registered User

    Status
    Offline
    Join Date
    Mar 2006
    Posts
    17
    Thanks
    0
    Thanked 0 Times in 0 Posts
    ok well im a member of the uklinkexchange, well here are some of my sites im trying to promote:

    www.friends4always.co.uk
    www.baublesbanglesbeads.co.uk
    www.bestwear.co.uk
    www.giftsforalways.co.uk

    If anyone wants to link up email me at media8@btconnect.com or contact me on the uklinkexchange.co.uk

    Also putting your websites on directories is another good idea?



Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 1
    Last Post: 16-05-06, 11:25 AM
  2. search engine question?
    By paulmacd in forum Affiliate Marketing Lounge
    Replies: 6
    Last Post: 01-04-06, 02:33 AM
  3. ok may be a dumb question regardinf affiliate managers
    By deadgoodundies in forum Affiliate Marketing Lounge
    Replies: 8
    Last Post: 06-12-05, 11:59 AM
  4. robots.txt
    By bertm in forum Programming
    Replies: 1
    Last Post: 17-12-02, 08:25 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
To Top

Content Relevant URLs by vBSEO 3.5.0 RC2