Google Bard shamelessly tells my World War II stories[1]. Bing Chat refuses to answer such a question or says “no information” depending on its creativity level.
Although that's garbage for factual tasks, the creative writing behavior is a perfect fit for fleshing out dnd characters for example. On the other hand, Google is a search/ad company... I'd think they'd be the most interested in integrating search/facts into an llm. Hallucinating details about your customers is a good way to cause problems (some lawsuits already filed).
> On the other hand, Google is a search/ad company... I'd think they'd be the most interested in integrating search/facts into an llm.
At its core, an advertisement is made of two components: the subject - a store, a brand, a product, etc. - with which the victim is supposed to develop positive associations, ideally strong enough to motivate a purchase and/or advertising the subject to their acquaintances, and the message, which is meant to create those associations. Only the first part, the subject, has to be factual. The message does not, and in fact it usually isn't - manipulative bullshit performs much, much better, and generally the optimum for advertising seems to be asymptotically close to the line past which it would be legally fraud.
The only factual part, the subject, needs accurate handling, and is best suited for classical database systems - which is exactly how Google, and everyone else, is handling it. The message part - that's a good match to LLMs, which excel at producing convincingly sounding bullshit. For advertising, it seems what you need is to crank up the hallucinations a bit, but have some plausible deniability built into the whole system, so that when the LLM hallucinates in too obvious a way, no one can actually be held responsible.
Wow that's a lot of creativity - not only did it make up a bunch of information, that information doesn't even make sense within the well known and understood historical context of WW2 (Turkey was neutral so there is no scenario under which a Turkish soldier is "sent to the Eastern Front to fight the Soviet Union").
[1] https://twitter.com/esesci/status/1669066574366646274