There's no client setup and I can access it from just about anywhere.

I used to optimize for the same scenario. But I realized that I very rarely use random machines that aren't my own. Plus my habits shifted even further once I started relying on my own (intentionally) private services accessible over Tailscale. These days I'm uncomfortable logging into anything of importance on a public machine without using a one time password or at least dual factor authentication, which isn't always possible.

I use email services which support U2F, such as yubikey. Thankfully that is supported in most environments today.