Mercurial > dottes
annotate web/robots.txt @ 288:5d367c68a494
Demote Staffordshire Hornpipe and Sonny Brogan's Mazurka to the Library.
author | Jim Hague <jim.hague@acm.org> |
---|---|
date | Fri, 05 Jul 2013 20:16:46 +0100 |
parents | f2c8ca48b8a4 |
children |
rev | line source |
---|---|
222
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
1 # Stop indexing of this site. |
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
2 User-agent: * |
f2c8ca48b8a4
Add robots.txt instructing the site not to be indexed.
Jim Hague <jim.hague@acm.org>
parents:
diff
changeset
|
3 Disallow: / |