Hacker News new | past | comments | ask | show | jobs | submit login

I added support for this model to my LLM CLI tool via a new plugin: https://github.com/simonw/llm-command-r

So now you can do this:

    pipx install llm
    llm install llm-command-r
    llm keys set cohere
    <paste Cohere API key here>
    llm -m command-r-plus "3 reasons to adopt a sea lion"
One of the most interesting features of the Cohere API models is that they can run web searches and use the results as part of answering the prompt.

The plugin adds that as a separate command, which works like this:

    llm command-r-search 'What is the LLM CLI tool by simonw?'
Example output (truncated here):

    The LLM CLI tool is a command-line
    utility that allows users to access large
    language models. It was created by Simon
    Willison and can be installed via pip,
    Homebrew or pipx. The tool supports
    interactions with remote APIs and models
    that can be locally installed and run.
    Users can run prompts from the command
    line and even build an image search
    engine using the CLI tool.

    Sources:

    - GitHub - simonw/llm: Access large
    language models from the command-line -
    https://github.com/simonw/llm
    - llm, ttok and strip-tags—CLI tools for
    working with ChatGPT and other LLMs -
    https://simonwillison.net/2023/May/18/cli-tools-for-llms/



Another, smaller (7B) model optimized for function calling and structured data is https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B

Maybe not as powerful, but more suitable for running locally on mid range devices.


I tried the original command-r in an agent setup, and it ended up lobotomized when the agent relied on its results. It has some weird gaps. Like, ask it for the pricing for Claude 3 models and it only lists the prices for output tokens, and only for text. I managed to get the input cost for text out of it, but I could not get it to even acknowledge that image input was a thing. Command-r+ just did exactly the same.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: