Perhaps you are right. I have experienced downvotes primarily in semi politicized discussions like automation, economics blockchain, diversity discussions. Most technical posts seems fairly balanced.

Perhaps yeah abolish downvote and only have flag for admins and people with high karma is a good idea.