You might argue that, but the point isn’t about the receiver/listener side, but rather the speaker, obviously knowing where X will be about that person knowledge in geography, but for the speaker to assume that everyone you are talking to as if they are living in the same country as him/her, imagine you are talking to someone from .. say Thailand, and instead of mentioning the country, they say they from Phayao -a province name, of course, if you happen to be knowledgeable in that region geography or visited before you might know, but it’s still a communication hurdle to assume everyone will.
It could just be that I'm meeting with more educated folks, granted.