Adds robots.txt
This commit is contained in:
parent
662ddf44b9
commit
4115edad6e
2 changed files with 10 additions and 1 deletions
5
bookwyrm/templates/robots.txt
Normal file
5
bookwyrm/templates/robots.txt
Normal file
|
@ -0,0 +1,5 @@
|
|||
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
|
||||
|
||||
User-agent: *
|
||||
Disallow: /static/js/
|
||||
Disallow: /static/css/
|
Loading…
Add table
Add a link
Reference in a new issue