Yep, but most of us are nowhere near that level where we have so much that more muscle is a disadvantage ;) I guess it's highly dependent on how you currently are. Someone who does weightlifting in a gym could probably indeed improve his cycling performance just by removing muscle.

And of course sports performance is not the only criterion for choosing +5lbs muscle vs -5lbs fat ;)