annotate web/robots.txt @ 388:7c3f90bf81df

Added tag build-default-172 for changeset 502fa2df300e
author Jenkins Build Manager <jenkins@cryhavoc.org.uk>
date Sat, 31 Aug 2013 01:03:51 +0100 (2013-08-31)
parents f2c8ca48b8a4
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
222
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
1 # Stop indexing of this site.
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
2 User-agent: *
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
3 Disallow: /