But the barrier to entry to being an effective bad actor is much higher, and some harm is prevented even if not all.

I think your point is valid to consider but it uncharitably overlooks the positives of the other side's proposition and reduces it down to all or nothing.