Added robots.txt, nofollow in metatags

Also noindex on /print/ pages
This commit is contained in:
Trevor Buckner committed 2020-04-20 13:46:18 -04:00
1 parent bdf37d8fe7
commit e88253f364
6 files changed
+19 -7

No files matched your search

+5
View File
@@ -0,0 +1,5 @@
# Disallow crawling brew edit and share pages
User-agent: *
Disallow: /edit/
Disallow: /share/
Disallow: /print/