A simpler explanation for valuing simplicity is that a simpler theory requires less storage/processing of the human brain. A more complex theory could explode in complexity so that all of its parts and ramifications wouldn't be easily learnable by a human.