> I have never switched keyboard layout (this honestly to me sounds like the biggest waste of time I have ever heard of).

Being someone who did that, yes I would say so and recommend against it. However one thing I can say about it is that it (Colemak to be specific) felt legitimately more comfortable, having all the most frequently pressed keys on the home row. If you're suffering from RSI it might help.