Sure it's not without cost, but in most cases the cost is not very high.

Remember you don't need to throw away the whole frame, only the pixels that were obstructed. One track across a frame will obstruct less than 1% of the data in that frame.