Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Grep for the internet.

What I often want is not a search engine, not a recommender, but a filter. Something that would allow me to look at the distributions of content on the Web rather than trying to answer my questions. I badly wanted to pay someone a few quid for a service like this, but had to build it myself.

Feel free to piggyback on the next batch job; use fBd7guQLDLx6RIm00GE7uH5h0Lk1CKKl as access key.

https://alpha.crawlfilter.com/



Cool.

Suggested secondary source: https://archive.org/details/alexacrawls?&sort=-publicdate&pa... (spotty; sometimes the crawls are dark and can't be read)

Also: when you get lucky with ACD: https://redd.it/5s7q04 (I've heard other users getting hard-capped at 100TB though)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: