Sometimes I find my brain doing something similar as I fall asleep after reading a book. Feeding me a stream of words that feel like they're continuing the style and plot of the book but are actually nonsense.
I think GPT tech in general may "just" be a hypertrophied speech center. If so, it's pretty cool and clearly not merely a human-class speech center, but already a fairly radically super-human speech center.
However, if I ask your speech center to be the only thing in your brain, it's not actually going to do a very good job.
We're asking a speech center to do an awful lot of tasks that a speech center is just not able to do, no matter how hypertrophied it may be. We need more parts.
>already a fairly radically super-human speech center
>We're asking a speech center to do an awful lot of tasks that a speech center is just not able to do
Exactly!
>We need more parts.
Yeah, imagine what happens once we get the whole thing wired up...