Mercurial > dottes
annotate web/robots.txt @ 437:8b4678e4ccdc build-default-189
Automated merge with ssh://hg.cryhavoc.org.uk/dottes
author | Jim Hague <jim.hague@acm.org> |
---|---|
date | Thu, 17 Oct 2013 13:11:35 +0100 |
parents | f2c8ca48b8a4 |
children |
rev | line source |
---|---|
222
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
1 # Stop indexing of this site. |
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
2 User-agent: * |
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
3 Disallow: / |