For any given statement, the answer up until a couple years ago was, "the speaker". Speakers get to decide what to say, but they're also responsible for what they say. But now with LLMs we have plausible text without a speaker.
I think we have a number of historical models for that. A relevant one is divination. If you bring your question to the haruspex, your answer is read out of the guts of a sacrificed animal. If the answer is wrong, who do you blame? The traditional answer is the gods, or perhaps nobody.
Bu we know now that fortune tellers are just selling answers while pretending to not be responsible for them. Which points us at one solution: anybody selling or presenting LLM output as meaningful is legally responsible for the quality of the product.
Unfortunately, another model is the modern corporation. Sometimes the people in a company intentionally lie. More often, statements are made by one person based on a vision or optimism or confusion or bullshit. Nobody set out to lie, but nobody really cared about the truth, at least not as much as everybody cared about making money.
So I'd agree that the government doesn't have much role in deciding The Truth. Similarly, the government shouldn't have much role in controlling what you eat. But in both cases, I think there's plenty of role for the government in ensuring that companies selling good food or good information have sound production and quality control measures to ensure that they are delivering what consumers are expecting.
I didn't say it has the same competencies and biases as any human - I said we can judge it on it's individual merits, the same way we judge any human on theirs.
No, you can't judge it the same way you judge a human, any more than you could judge a bus engine the same way you'd judge human. It's not an individual, and not remotely like one.
I get this might seem like tedious nitpicking to you, but the number one error people are making with LLM output is anthropomorphizing it. Which I get, because it's built to seem that way. But it's an enormously dangerous misconception.
As one example among zillions, look at the term "hallucination". All LLM output is equally "hallucinated". Some of it, when interpreted by a human may be taken as meaningful. Some of it, the "hallucinated" part, is taken as meaningful but contrary to something else they understand. But it's the human creating all the meaning here. Even calling this class of mismatches "hallucination" is anthropomorphizing LLMs.
Imagine I take the proverbial million monkeys to generate random words. Then I create a statistical filter so that we extract only the plausible sentences. Is this machine a source? Can I "judge just like any human source" here?
I'd say the answer is a clear no. And if you think the answer is yes, then the same has to apply to things like horoscopes, the I Ching, or the intestines of a sacrificial goat.
I can judge the utility of a black box oracle on it's own merits, without needing to know whether it's human, and without being accused of anthromorphizing it.
If I've observed the answers of the oracle to be biased, or useful/correct in some circumstances and not in others, then this is something to take into account when deciding whether or not this is a useful source to pay attention to.
From the POV of whether the output of the black box is useful, it doesn't make any difference whether what's in the box is a human, an LLM, or a rabid monkey. It is what it is, and I'll judge it on it's merits.
Now, YOU may care what's in the box, for some reason, but that's on you.
> Who Gets To Decide What Is True?
For any given statement, the answer up until a couple years ago was, "the speaker". Speakers get to decide what to say, but they're also responsible for what they say. But now with LLMs we have plausible text without a speaker.
I think we have a number of historical models for that. A relevant one is divination. If you bring your question to the haruspex, your answer is read out of the guts of a sacrificed animal. If the answer is wrong, who do you blame? The traditional answer is the gods, or perhaps nobody.
Bu we know now that fortune tellers are just selling answers while pretending to not be responsible for them. Which points us at one solution: anybody selling or presenting LLM output as meaningful is legally responsible for the quality of the product.
Unfortunately, another model is the modern corporation. Sometimes the people in a company intentionally lie. More often, statements are made by one person based on a vision or optimism or confusion or bullshit. Nobody set out to lie, but nobody really cared about the truth, at least not as much as everybody cared about making money.
So I'd agree that the government doesn't have much role in deciding The Truth. Similarly, the government shouldn't have much role in controlling what you eat. But in both cases, I think there's plenty of role for the government in ensuring that companies selling good food or good information have sound production and quality control measures to ensure that they are delivering what consumers are expecting.