Hacker News new | past | comments | ask | show | jobs | submit login

https://github.com/robots.txt

I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?




They've moved from robots.txt to blocking by headers.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: