> Perhaps the "random" number generated after a handshake is not so random and actually identifies you as a user?

If the RNG isn't random then the protocol just broke and HTTPS turns into paperweight.

You usually get tracked by your browser and remote IP much easier than tracking details in the TLS connection.