Non-immigrant workers do pay the same taxes as citizens, however, they don't pay them over the same time period.

If a citizen starts working at 18, gets laid off at 32 and doesn't find another job until 34, that's much cheaper than a non-immigrant who comes to the US at 32 and ending up on unemployment at 34 for 2 years before going back home.