I get a little annoyed when people say that I'm German. I mean, despite my ancestry, I was born in America, and I've never even been to Europe. And I'm a little annoyed other times when people refer to "native Americans" as if I'm not one of those.

Those are little annoyances. I don't believe that the speaker is trying to disrespect me -- certainly not intentionally -- and I take it with a grain of salt.

In other words: this seems like making much to-do over very little.