Alt+click avoids that in Firefox at least. Blew my mind when I learned about that, and I use it way more often than expected.