Added robots.txt, nofollow in metatags

Also noindex on /print/ pages
2026-06-27 08:28:40 +00:00 · 2020-04-20 13:46:18 -04:00
parent bdf37d8fe7
commit e88253f364
6 changed files with 19 additions and 7 deletions
@@ -0,0 +1,5 @@
+# Disallow crawling brew edit and share pages
+User-agent: *
+Disallow: /edit/
+Disallow: /share/
+Disallow: /print/