Seems like this is part of the feedback loop that will render AI useless though.

No, it's an effective technique that has been used by Microsoft Research among many others.

But who monitors the monitor?

At a certain point you just need to take a statistically representative sample of the output for review.