Why can't you build a great product working by your schedule? Working on a team doesn't mean being with the team at all times. You need both time alone and time together.
That was exactly my point. I want to be able to work by my own schedule (with reasonable overlap with the team) and still build a great product. What I feel is that companies (or atleast mine) aren't structured this way.