Hacker News new | past | comments | ask | show | jobs | submit login

You can get 1t/s on a raspberry pi.

https://youtu.be/o1sN1lB76EA?si=i8ecEBjLdV0zewFQ




this has nothing to do with the full 671B and the ollama models are distilled qwen2.5


I appreciate both of these comments, thank you both.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: