"Free as in speech" is very, very close to "free as in beer".

For all practical purposes it doesn't cost me anything more than my time to exercise my free speech rights.

Something that's nominally "free" from direct government control but the government gets to dictate the monetary cost of using it is not free by either definition.

Anything that increases the monetary cost of freedom of movement (time is not such a big deal because rich and poor alike have 24 hours in the day, hence I don't see traffic jams and crowded subway platforms being that big a deal) is a bad thing, even if the increase is a trivial amount to the upper classes. Mass transit (not the same thing as public transit though the sets intersect) should not be like a restaurant where you pay $50 for a $20 meal because that keeps the poors out and that is exactly what congestion fees and tolls are designed to do.

The freedom of speech analogy is pretty good.

Yes you can talk freely, but if you want to say something louder than everyone else, you typically have to pay for advertising or a platform.

You can move freely, but if you want to move faster/farther than others, you have to pay for it.

Not to mention that if you say the wrong thing, you can get fired, costing you a whole lot of money.