Retry sequences are unlikely to be the kind that the branch prediction is that important? I'd also expect that they are larger than the threshold that is common for branches that are likely to be taken many times.

That is, the stuff that will go into a retry of something likely has far more setup than your typical hot loop.