I will agree that land is a special case, but that’s why we tax it continually.

I think society needs property tax to perform well, or else people will horde control of land under the mistaken belief that they can sell or rent it for high prices. You need tax to bring people back to reality and force them to use it productively in the present.