it takes some practice. and i find it's more difficult with short stories because there every detail counts. if you miss a few details from a longer book, it tends to matter less.
and then while listening i need to do an activity that doesn't require mental focus.
so i can't sit in front of the computer, unless it is mundane photo editing or some other repetitive task that doesn't make me think.
going for a walk and housework work for me. especially housework. there is nothing else i can do while washing dishes, cooking, doing laundry or cleaning. the work doesn't require much focus, and is quite repetitive. that makes listening easy.
it does depend on the writing style though. it happens more when the story is difficult to understand.