Re: "I think it is more fundamental that models are trained using existing data."

Yes, I agree, but this does not have the be the final word. There is a lot of room for design. For example, an autosuggestion tool can trade off between exploration (randomized recommendations) and exploitation (pure collaborative filtering).