Because it's a very misinformed opinion. For 1 it isn't arbitrary and it isn't a random person. It is elected officials that set the tax and the price is based on the community budget. Where I live we have high property taxes but we don't complain because we vote for this. We want nice schools, clean parks that are manicured, frequent refuse and recycling service, clean streets, a well staffed police force and fire departments, a fancy 4th of July parade, etc. This stuff isn't free and we choose to fund it with property taxes instead of income taxes, etc.
If you won't or can't pay your tax then you have to sell your property to someone who can. This is what the community that lives in an area agreed on. You can take your house with you though. It's totally up to you to lift it, put it on a truck and put it on a different piece of land, considering the bank doesn't own it. Feel free to find land with no taxes and put your home there.