Most people don't exercise enough, so that's no surprise. The important thing is that top athletes don't exercise as much as they possibly could because doing so would be counterproductive.

They have also spent years building up the capacity to exercise as much as they do. If you go straight from an office job lifestyle to top athlete levels of effort, you'll get injured.