The problem is less that those high level engineers are only good at deterministic work and more that they're only rewarded for deterministic work.

There is no system to pitch an idea as opening new frontiers - all ideas must be able to optimize some number that leadership has already been tricked into believing is important.