"LLMs develop most of their skills during pretraining—but success depends on the quality, size, and variety of the data they consume. So much text is needed that it is practically impossible for an LLM to be taught solely on vetted high-quality data. This means accepting lower quality data, too. For the armed forces, an LLM cannot be trained on military data alone; it still needs more generic forms of information, including recipes, romance novels, and the day-to-day digital exchanges that populate the Internet."
Being reminded of that fact it occurs that LLMs are to decision making systems what Mortgage Backed Securities (MBS) were to investment. "AAA" rating with tranches full of crap.
"LLMs develop most of their skills during pretraining—but success depends on the quality, size, and variety of the data they consume. So much text is needed that it is practically impossible for an LLM to be taught solely on vetted high-quality data. This means accepting lower quality data, too. For the armed forces, an LLM cannot be trained on military data alone; it still needs more generic forms of information, including recipes, romance novels, and the day-to-day digital exchanges that populate the Internet."
Being reminded of that fact it occurs that LLMs are to decision making systems what Mortgage Backed Securities (MBS) were to investment. "AAA" rating with tranches full of crap.
That didn't end well, did it?