I used to bring my dog almost everywhere: work, stores, restaurants (seated outdoors), the bank. He only waited outside grocery shops and a few places like that. His photo was on my work ID badge.
He weighed about 150 lbs and was meek as a lamb and people rarely objected.
unfortunately dogs owner seem genuinely incapable to realize that some people are allergic and are simply not comfortable with unpredictable animals in public places.
Side note: The comment I responded to has since been edited. It originally said that that the last time he went to Fry's a customer's dog pooped and the next guy entering the store nearly stepped in it (and he made a joke about how the store is going to shit).