Hacker News new | past | comments | ask | show | jobs | submit login

Crawling is difficult these days as recaptcha and other measures keep bots out if you are not google or MS



That is quite unfortunate. How the hell are new original search engines supposed to compete?


I’ve worked in this space for over two years. They can’t. It’s simply not possible. The only feature that’s feasible to offer is privacy. You’ll never be able to catch up to Google or Bing with crawling.


In your opinion, do you think a new original search engine can survive in this landscape? Of course it would always be behind Google and Bing by about 15 years.

I've been reseasrching some ideas.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: