Mercurial > dottes

annotate web/robots.txt @ 366:5628fcd6c692

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Don't mark SSI files executable. We now archive to publish, and archiving loses the executable bit, so I've had to enable SSI for all .html anyway.
author Jim Hague <jim.hague@acm.org>
date Wed, 21 Aug 2013 13:51:52 +0100
parents f2c8ca48b8a4
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
222
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
1 # Stop indexing of this site.
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
2 User-agent: *
f2c8ca48b8a4 Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff changeset
3 Disallow: /