I'm starting to feel like LLMs need to be tuned for shorter responses. For every short sentence you give them they outputs paragraphs of text. Sometimes it's even good text, but not every input sentence needs a mini-essay in response.

Very cool project though. Maybe you can fine tune the prompt to change how chatty your AI is.