> Knowing that something is definitely a breaking change because an API was removed or modified in an incompatible way will still save you time.

Iff it's a part of the API you use directly or indirectly. Sometimes you're only using part of it, and changes to the rest don't matter.