Hallucinations come in all sizes. I wouldn't worry about the big hallucinations - those are easy to spot. I worry about the small, incremental hallucinations - the ones you don't notice until several have happened. It might not be possible to even recognize that sort of thing yourself, if you've been effectively gaslighted by AI.
Since there's no actual knowledge on the part of the AI, it doesn't know that it's doing it, so it's not malicious (the designers are a separate question). But it is still entirely possible, and even somewhat likely.
Since there's no actual knowledge on the part of the AI, it doesn't know that it's doing it, so it's not malicious (the designers are a separate question). But it is still entirely possible, and even somewhat likely.