(I have not downvoted you. I don't have the karma to downvote yet and have been replying to you so I can't anyway)

People upvote for agreement, it only makes sense that they downvote for disagreement as well. I'm fairly certain that PG has said that he is ok with that before.

You can be pretty sure that you will always be downvoted for complaining about downvotes though, even by people that may agree with you.