qiurui
/
freebsd-doc
mirror of https://git.FreeBSD.org/doc.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

allow to crawl the ports search homepage at ports.freebsd.org

This commit is contained in:
Wolfram Schneider 2024-03-31 13:42:52 +00:00
parent 5aae02b0dc
commit cc3c174a51
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
website/themes/beastie/layouts/robots.txt
View File

@ -1,6 +1,6 @@
User-agent: *
Disallow: /cgi/man.cgi?apropos=2&
Disallow: /cgi/ports.cgi
Disallow: /cgi/ports.cgi?
Disallow: /cgi/man-autocomplete.cgi
Disallow: /cgi/ports-autocomplete.cgi
Disallow: /statistic