The only people in the world that I have ever heard say they would not think on a link with the face because they thought it would be a social link or an ad are the people on Hacker News. Why this is I'm not really sure. But I have to agree with this article, Google authorship did not make their rankings decrease at all. It was other factors that they did not want to admit to.