0
0
mirror of https://github.com/naturalcrit/homebrewery.git synced 2026-01-17 23:12:39 +00:00

Added robots.txt, nofollow in metatags

Also noindex on /print/ pages
This commit is contained in:
Trevor Buckner
2020-04-20 13:46:18 -04:00
parent bdf37d8fe7
commit e88253f364
6 changed files with 19 additions and 7 deletions

5
robots.txt Normal file
View File

@@ -0,0 +1,5 @@
# Disallow crawling brew edit and share pages
User-agent: *
Disallow: /edit/
Disallow: /share/
Disallow: /print/