I've been passionate about superforecasting and AI for a long time, so decided to try and use LLMs to structure data about the world -- commodities, politics, etc. It's now a startup we're trying to get off the ground: https://emergingtrajectories.com/
Most of my days are spent reading the news and working on LLMs, which has been a blast. As an example, here's a dashboard that tracks major supply and demand shocks to various commodities around the world: https://emergingtrajectories.com/c/commodities
Thanks for asking! Yes, but we're actively addressing them.
We do a few things under the hood to make hallucinations significantly less likely. First, we make sure every single statement made by the LLM has a fact ID associated with it... Then we've fine-tuned "verification" LLMs that review all statements to make sure that assertions being made are backed up by facts, and that the facts are actually aligned with the assertion.
It's still possible for the LLM to hallucinate in this process, but the likelihood is much lower.
Most of my days are spent reading the news and working on LLMs, which has been a blast. As an example, here's a dashboard that tracks major supply and demand shocks to various commodities around the world: https://emergingtrajectories.com/c/commodities