They already do, we just released a model equivalent to most 40-60b base models that runs on a MacBook Air no problem.

It's like 1.6gb, ones coming are better and smaller https://x.com/EMostaque/status/1732912442282312099?s=20

I think the large language model paradigm is pretty much done as we move to satisficing tbh