Hacker News new | past | comments | ask | show | jobs | submit login

Main reason I started using ollama is because it actually worked. I spent half an hour trying to get huggingface models to run on my GPU with no success. Meanwhile `sudo pacman -S ollama-rocm` seemed to just work out of the box.



Exactly, and as a bonus it runs an JSON API on localhost so you can call it from anything on your LAN, it's really, really amazing




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: