Hacker News new | past | comments | ask | show | jobs | submit login

Dunno about currently, but about three years ago, if you opened your own site in Chrome, a couple minutes later you'd get a visit from Google bot on the same url.



I don't believe this to ever have been the case.

Not only is Google's indexing infrastructure not that fast, but they deliberately don't do that because some poorly designed sites have passwords or unique keys in the URL that should not be used to retrieve content for the public search index.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: