Mercurial > dottes

annotate web/robots.txt @ 410:723aa1ff3b8b

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Add link from dots page to learner page and vice-versa.
author Jim Hague <jim.hague@acm.org>
date Tue, 03 Sep 2013 10:02:59 +0100
parents f2c8ca48b8a4
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
222
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
1 # Stop indexing of this site.
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
2 User-agent: *
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
3 Disallow: /