These models are not trained to act like a single human in a conversation, they're trained to be every participant and their average.
Every instance of a human choosing not to engage or speak about something - because they didn't want to or are just clueless about the topic, is not part of their training data. They're only trained on active participants.
Of course they'll never seem like a singular human with limited experiences and interests.
The output of those AIs is akin to products and software designed for the "average" user - deep inside uncanny valley, saying nothing specifically, having no specific style, conveying no emotion and nothing to latch on to.
It's the perfect embodiment of HR/corpspeak which I think its so triggering for us (ex) corpo drones.
Every instance of a human choosing not to engage or speak about something - because they didn't want to or are just clueless about the topic, is not part of their training data. They're only trained on active participants.
Of course they'll never seem like a singular human with limited experiences and interests.