Yes, a quantum computer with a few hundred error-corrected qubits (many more before error correction) would clean out all addresses with exposed public keys, by solving Elliptic Curve Discrete Log to recover the private key.

This includes many old addresses that didn't hash the public key, any re-used addresses, and, using replace by fee, even all new addresses in the time frame between broadcasting a spend transaction and that transaction being included in a block (which can currently take many hours).