If that ever becomes an actual problem, our entire society will be at a filter point.

This is the problem with these kind of incremental mitigations philosophically -- as soon as the actual problem were to manifest it would instantly become a civilization-level threat that would only be resolved with drastic restructuring of society.

Same logic for an AI that replaces a programmer. As soon as AI is that advanced the problem requires vast changes.

Incremental mitigations don't do anything.