He wore a kilt, which is actually an interesting addition to my point. Despite the strong masculinity of a kilt, they do not appear to be very popular in modern society. I would suggest without evidence that this is in no small part due to a potential association with "feminine" skirts.

They are not popular, but men wearing them won't have their sexuality judged, so they probably don't have significance to your original point. I think they are not popular because they have a strong cultural association with being Scottish.