> Users do not know how to tell a good search engine from a bad one.
I am sure there is a presentation bias. I am sure that there are plenty of cases where a user cannot tell if a set of results are good or bad for a specific query. I am sure some users have trouble communicating why they think a specific result is good or bad.
However can people tell the general quality of a search engine? Absolutely. Google's simple aesthetics certainly helped them, but they didn't become the top search engine by luck and aesthetics alone. AltaVista, Yahoo, Lycos, Excite were all junk compared to Google, even the first version. It was very obvious.
I totally agree that google blew its competitors out of the water in the 90's. I switched to Google literally ten seconds after running my first query!
The research I'm citing is from the late 00's. At this point in the game, differences in search relevance are in the measurement noise.
I am sure there is a presentation bias. I am sure that there are plenty of cases where a user cannot tell if a set of results are good or bad for a specific query. I am sure some users have trouble communicating why they think a specific result is good or bad.
However can people tell the general quality of a search engine? Absolutely. Google's simple aesthetics certainly helped them, but they didn't become the top search engine by luck and aesthetics alone. AltaVista, Yahoo, Lycos, Excite were all junk compared to Google, even the first version. It was very obvious.