I can only say this is no issue for me. I'm currently using colemak dh on a dactyl manuform like keyboard and switch to using a macbook keyboard constantly because I use 2 devices. and even with the different layouts it doesn't make a difference for me. I think these bigger changes are easier to get used to than just smaller ones where for example the shift key is just a little longer that stuff always throws me off