It totally would, if Bing doesn't return relevant results.

I've asked BingGPT about myself and it gave me three answers. One was more or less on-point (it found my linkedin profile), and the other two were hallucinations. What happened was Bing found two unrelated pages and GPT has tried and failed to make sense of them.

Either that, or I am a prince whose name means "goose" in Polish.