"Meritocracy is not as good an idea as it seems to be in practice"
Why not just consider that it is a label which may not apply to the reality you observe? Have we gotten to the point where considering that any X is not Y is considered a "no true Scotsman" fallacy?
The only problem with meritocracy is that it's unattainable in a society with inherited power differences. Other than that it would be a great idea. Just one that hasn't truly been tried outside limited organisations yet.