I agree. If there's a bug here, it's in the server which collapses slashes seen ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

kentonv on Sept 11, 2014 | parent | context | favorite | on: Google search indexes itself

I agree. If there's a bug here, it's in the server which collapses slashes seen in request paths, not in the indexer's interpretation of robots.txt.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact