How would it know? If anything this is one of the only places where it’s not an ouroboros because of the citations.
But yeah, I have to imagine LLM-produce material is already on its way back into the next models. I wonder how this problem is perceived among the people building these systems. Given that they’re not yet near ASI or AGI yet, it’s gotta be close to an existential issue, no?
Maybe not “your company will collapse,” but “you will not be able to get further improvements.”
Would love to hear thoughts from someone who is actually addressing this (or knows why we don’t need to).
There is a demand for Low Background Steel, steel produced before the Nuclear Bombs were dropped, for use in Geiger counters and the like. It's usually salvaged from the wrecks of sunken WW1 ships, as that is the only way to guarantee no radiation.
The same will happen to data sets from pre-2022, everything beyond that will be rapidly polluted with AI nonsense.
But yeah, I have to imagine LLM-produce material is already on its way back into the next models. I wonder how this problem is perceived among the people building these systems. Given that they’re not yet near ASI or AGI yet, it’s gotta be close to an existential issue, no?
Maybe not “your company will collapse,” but “you will not be able to get further improvements.”
Would love to hear thoughts from someone who is actually addressing this (or knows why we don’t need to).