If the government punishes you for what you say then of course it's a free speech issue, that's the whole point.

It doesn't matter what exact punishment is applied: e.g expulsion from a country club or a fine.