The concern is that the models do some fantastic sci-fi magic, like diamond nanobots that turn the world into grey goo, or hacks all the nukes overnight, or hacks all human brains or something.
But, whenever you point this out the response will usually be able to quibble over one specific scenario that I laid out.
They'll say "I actually never mentioned the diamond nanobots! I meant something else!"
And they will do this, without admitting that their other scenario is almost equally as ridiculous as the hacking of all nukes or the grey goo, and they will never get into specific details that honestly show this.
Its like an argument that is tailor made to being unfalsifiable and which is unwilling to admit how fantastical it sounds.
The concern is that the models do some fantastic sci-fi magic, like diamond nanobots that turn the world into grey goo, or hacks all the nukes overnight, or hacks all human brains or something.
But, whenever you point this out the response will usually be able to quibble over one specific scenario that I laid out.
They'll say "I actually never mentioned the diamond nanobots! I meant something else!"
And they will do this, without admitting that their other scenario is almost equally as ridiculous as the hacking of all nukes or the grey goo, and they will never get into specific details that honestly show this.
Its like an argument that is tailor made to being unfalsifiable and which is unwilling to admit how fantastical it sounds.