12 Ways to Keep Your Content Hidden from the Search Engines

Submitted by Tobias Eigen on 1 May, 2008 - 17:29.

There are times when you don't want Google and other search engines to send their spiders to index your website content so it appears in search results. This article at SEOmoz presents 12 very useful methods for keeping your content out of search engines. At Kabissa, we typically use the first method, robots.txt, to gently ask search engines to not index the site - however it is not foolproof as not all search engines respect robots.txt.

If you really want to keep people from finding and accessing your content, you will need to put your content behind a password.