Hacker News new | past | comments | ask | show | jobs | submit login

What if someone wanted to get a large number of results, more than 300, for a common term found on the web. Is Google suitable for such a task.

How could this be proven. Search for the term "example" and see how many results can be accessed. Is it greater than 300.

By limiting the number of results that can be accessed, Google is "hiding" a portion of the web from the user. How do we explain this practice. Perhaps that portion is not deemed useful for user data collection or advertising purposes hence it is excluded. Perhaps Google wishes to prevent users from accessing large chunks of its index. Who knows.

We need a search engine that exposes the full web and does not try to guess what someone is searching for. If the user requests all pages with the term example, then that is what the search engine returns. Google is far too limited.

If one goes to a library and searches an academic database, she is never precluded from viewing all results. Even though she may only access the first few pages, she is always allowed to see all the results. She can view results that were low on the relevance scale to understand why they scored low. She can then subsequenty narrow her search. I have seen this implemented in non-academic databases as well. First a broad search is performed. It returns all results, not just a portion. These results are stored. Every single result is accessible by the user. (Not possible with Google. User only sees 200-300 max.) Then the user can narrow her search and search within those results. The user repeats using different searches until she has what she wants. The user controls the number of database items she wishes to search, based on the initial broad search. With Google, the user has no such access to all results from a broad search, nor the ability to search exclusively within that set. Google is extremely limited. Everything is geared toward user data collection and online advertising. It truly detracts from any search functionality they may have to offer. The user is the product, not the database.




They never let you past the 1000 mark, not even on paid API. It's frustrating when you want to do more advanced searches.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: