This file must be placed in your 'www' directory in order for a search engine to see it.

The sample below tells search engines not to index pages in the specified folders.

---- robots.txt  (contents follow)

User-agent: *
Disallow: /cgi-bin/
Disallow: /images
Disallow: /secret
Disallow: /members

---- end (Contents above)