I've been contemplating these exact same thoughts and ideas, and indeed have been very surprised how little exploration there seems to be around these nuances!
given the mechanics of language models, i think it's really interesting to consider them in group settings. how do you create an environment where they can "decide" to respond? how do they make that decision?
This is very interesting and thought provoking. On its face it sounds so simple - just put the bots in a room together and let them go at it. But of course it's much more complicated than that, at least if you want good and/or interesting results.
> Could you use a LLM function call to decide whether or not to respond
I've implemented this for a toy project before and it worked surprisingly well, yes! It can take some creative prompting to have the model understand which messages are actually directed at it, though, which I guess makes sense since every User message is _supposed_ to be?
Main thought is just that there are tons of situations that involve more than 2 people being in a discussion. some the of links I mentioned in the post get into this with the "facilitator" model.
Moderation/mediation is probably the most obvious thing "usecase." I'm more interested in just pushing the limits of what the language models can do and see what kind of things they'll do.
There's a corner of the internet interested in these models as a form of "alien intelligence." Don't immediately know what the application would be, but the results are super interesting
Ideally? Automatically answering support questions in open source discord channels, automatically taking minutes in business slack conversations.
Cynically? Your group chat is hosted by a tech company. That tech company wants to tell investors they've got an LLM, and show user counts going up. And the fastest way to boost user counts on a failing product is to make it an always-on feature of a successful product.
Is that the only thing you talk to your friends about?
I mean yeah literally you could talk about your plans [i.e. by yourself or with the other real people] or what's going on in your life and have the bot chime in with thoughts too. You could talk about food, philosophy, politics, travel, complain about stuff, get advice for relationships or work, gossip. All in a group chat setting.
It's not hard to imagine a bot that's able to contribute here and there in a meaningful way in any of these subjects, and other unlimited subjects. But perhaps you weren't open to it in the first place so I'm not going to try to convince you further if you don't buy it; If you don't want to really give it consideration then nobody is going to convince you otherwise.
reply