Interesting, I've generally had the exact opposite occur for me, though it depends on narrator and context.
I typically listen while driving. Anything past 1.25x was an illusion of productivity trap. I could hear the words and understand the concepts, but there wasn't any time to digest what I'd heard.
I find retention and understanding to be greatly increased when I don't get bored or distracted in between words and phrases.