Nobody’s making OP question their reality according to OP’s story. It just seems that OP was completely unaware of the manager’s opinion and now he became aware of it.

There’s nothing nefarious in that, happens all the time.