Hacker News new | past | comments | ask | show | jobs | submit login

I took a peek through the site and I really don't see a way to scrape everything, or even most stuff off of their site. You can get the 200 pages of the most recent bookmarks for any particular tag, but that seems to be about it.



User pages go back much farther, perhaps all the way. So if you can find a decently large set of users you should be able to come away with a large chunk.


It's possible, but would take years at the level of rate limiting they do.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: