My experience is that if you practice listening long enough it’s easy to focus. I’ve been doing it everyday for more than 5 years. I remember what you’re talking about but personally no longer experience it