JakeCop's Blog

Over the last few days there has been a bit of talk about the standards that are being developed to replace the Robots.txt file that all SEO’s use. Robots.txt was developed in 1994 when bandwidth was more precious, to stop search engines crawling sites to often and using up people’s bandwidths Robots.txt was developed to stop this and the search engines followed the standards though it was all voluntary. The new standards are called ACAP which stands for Automated Content Access Protocol. Now strictly talking this is not Robots.txt 2.0 because robots.txt does not have a working group behind it pushing the standard forward. The ACAP group was put together in 2006 and is backed by major European news papers and publishers. ACAP has been devised to provide more control over publi...