I think the Harvard part matters at least a tiny bit. A Harvard medical degree means your opportunity cost to do the startup thing is (marginally imo) higher than if you had a Cal State Fullerton medical degree.
And obviously the storyline "ZOMG he has an elite degree and still does thus" is more interesting for the random reader.