This is one of the reasons I ended up using the Mac app Movist (which was once open source, but later redone to be on the Mac App Store for $5). I actually mainly use this because of better shortcuts and because of its subtitle handling.