robots.txt question

[Svartgoth]

Tweet

I have just submitted a load of websites to be indexed to a load of search engines but when I did this I did not add the robot.txt file. Does this mean they absoultely wont be indexed by the search engines? Does this also mean that I would need to submit the websites again with the robots.txt file.

By the way what is a .htaccess file, whats its significance do I need to ask the robots.txt file to disallow access to this.

[breathe]

I think you will be OK and your sites will be indexed, The robots.txt file will give instructions on what content to index and what content is not allowed to be indexed. By default the bots index everything. A .htaccess file will lock the directory where the .htaccess file is located with a username and password, defined in the .htaccess file.

Hope that is helpful

[morleymouse]

.htaccess - dont worry about it, it can be used for alsorts but I dont think you'll need it for now. and it doesnt need to be blocked, its mostly server side stuff and cant be accessed by a search engines.

robots.txt - dont worry about it, it is just instructions for search engines, unless theres something you desperately dont want indexed you'll be okay.

submitting sites isnt the best way to get indexed and is generally the slowest, if you can get some other sites to link to you you'll get indexed a lot faster, ask around on here for some link exchanges you might drop on someone in the same boat.

[Svartgoth]

ok well im a member of the uklinkexchange, well here are some of my sites im trying to promote:

www.friends4always.co.uk
www.baublesbanglesbeads.co.uk
www.bestwear.co.uk
www.giftsforalways.co.uk

If anyone wants to link up email me at media8@btconnect.com or contact me on the uklinkexchange.co.uk

Also putting your websites on directories is another good idea?