I can ask the exact same question of an LLM multiple times and get different answers with the same degree of confidence. Hard to trust that, and also hard to fix.

Which wouldn’t be so problematic if people didn’t just turn off their brains when interacting with them.

Either way, everything you’re suggesting are possibilities for the future, which may or may not pan out. The bad comparisons to humans are happening today.