pipx install llm
llm install llm-command-r
llm keys set cohere
<paste Cohere API key here>
llm -m command-r-plus "3 reasons to adopt a sea lion"
One of the most interesting features of the Cohere API models is that they can run web searches and use the results as part of answering the prompt.
The plugin adds that as a separate command, which works like this:
llm command-r-search 'What is the LLM CLI tool by simonw?'
Example output (truncated here):
The LLM CLI tool is a command-line
utility that allows users to access large
language models. It was created by Simon
Willison and can be installed via pip,
Homebrew or pipx. The tool supports
interactions with remote APIs and models
that can be locally installed and run.
Users can run prompts from the command
line and even build an image search
engine using the CLI tool.
Sources:
- GitHub - simonw/llm: Access large
language models from the command-line -
https://github.com/simonw/llm
- llm, ttok and strip-tags—CLI tools for
working with ChatGPT and other LLMs -
https://simonwillison.net/2023/May/18/cli-tools-for-llms/
I tried the original command-r in an agent setup, and it ended up lobotomized when the agent relied on its results. It has some weird gaps. Like, ask it for the pricing for Claude 3 models and it only lists the prices for output tokens, and only for text. I managed to get the input cost for text out of it, but I could not get it to even acknowledge that image input was a thing. Command-r+ just did exactly the same.
Is that an instance of a "human in the loop"? Suppose a customer calls customer service and the service agent uses an LLM iteratively to get a good answer rather than the customer frustrating or even misinforming themselves. That seems to be like what you are describing.
CC-by-NC still seems better than the DBRX's license prohibiting usage for improving other models-
>2.3 Use Restrictions
> You will not use DBRX or DBRX Derivatives or any Output to improve any other large language model (excluding DBRX or DBRX Derivatives).
> Cohere For AI Acceptable Use Policy
> generating synthetic data outputs for commercial purposes, including to train, improve, benchmark, enhance or otherwise develop model derivatives, or any products or services in connection with the foregoing.
Tangential, but this is a horrible choice for a header font at this size. I thought something was wrong in the rendering as I noticed white random smudges in the text.
So now you can do this:
One of the most interesting features of the Cohere API models is that they can run web searches and use the results as part of answering the prompt.The plugin adds that as a separate command, which works like this:
Example output (truncated here):