Eh, I think it depends. I wouldn’t go out of my way to socialize with people who are uptight and easily offended or upset by dumb shit that I might say in a casual social setting, but most of us get roped into those situations from time to time, and being able to manage them without causing offense is worthwhile, even if you can only do that by being quiet.

Sure, but as a result I've grown more and more cautious about relaxing my guard which has made me more and more quiet in social situations.

Hopefully it helps to recognize the beneficial outcome of your action (which I pointed out). I've been there, so I'm trying to help.