Power imbalances and systemic issues are helpful for discussing society-level problems. It's useful to understand the broader society a jerk grew up in and see how certain societal norms might be involved.

I'd still be a jerk if I insulted a straight guy for being straight, and I wouldn't use "it's not bigoted because of a power imbalance" as a shield when someone calls me out on it. The power imbalance doesn't excuse it, and no amount of mincing words will make my words/actions look better even if I might be right if we keep it to a society-level discussion without considering individuals.