There is a point to be made that implementing it correctly, would involve extra code, for what is essentially an edge case. That extra code could prove to be a larger security concern that being 1 second of once in a while.

Your clock is almost certain to be a little of every now and again anyway. If it wasn't there would be no point in running ntp.