I've installed ollama and the open chat (?) software on a local machine. It was pretty simple to get working.
Is it 'just as simple' to install llama.cpp ?
If not, I would consider the ollama wrapper to have an actual use-case.
You can make a working wifi temp/humidity sensor with an esp32, dht22, esphome, and home assistant. It's not hard but many many people wouldn't have a clue where to start on this. They buy the more expensive packed items. Also, a useful use case.
Opening up any sort of demographic, may make it worth it. (But attributions should surely exist)
Is it 'just as simple' to install llama.cpp ?
If not, I would consider the ollama wrapper to have an actual use-case.
You can make a working wifi temp/humidity sensor with an esp32, dht22, esphome, and home assistant. It's not hard but many many people wouldn't have a clue where to start on this. They buy the more expensive packed items. Also, a useful use case.
Opening up any sort of demographic, may make it worth it. (But attributions should surely exist)