Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

On Mac Silicon, try Ollama as a means to easily download and run open LLMs.


Also works great on Linux if you have a high end desktop CPU.


After reading your comment, I spent a few minutes getting Ollama running on Google Colab - works great. First time I tried it on Linux + Intel.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: