status-im
/
consul
mirror of https://github.com/status-im/consul.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity

Fix robots.txt to disallow indexing of all paths 

The path pattern specified in allow / deny lines should start with a
forward slash to designate the root.

[1] https://tools.ietf.org/html/draft-koster-rep-00#section-2.2
[2] https://developers.google.com/search/reference/robots_txt
This commit is contained in:
Blake Covarrubias 2020-10-14 11:01:30 -07:00 committed by Blake Covarrubias
parent cea99991b2
commit d08e13e5bd
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ui-v2/public/robots.txt
View File

@ -1,3 +1,3 @@
# http://www.robotstxt.org
User-agent: *
Disallow: *
Disallow: /