FreakU
/
takahe
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
takahe/static/robots.txt

6 lines
87 B
Plaintext
Raw Blame History

User-Agent: *
# Don't allow any bot to crawl tags.
Disallow: /tags/
Disallow: /tags/*
Reference in New Issue View Git Blame Copy Permalink