Hacker Newsnew | past | comments | ask | show | jobs | submit | hugozap's commentslogin

I'm a happy user of Mistral on my Mac Air M1.


How many gbs of RAM do you have in your M1 machine?


8gb


Thanks, wow, amazing that you can already run a small model with so little ram. I need to buy a new laptop, guess more than 16 gb on a macbook isn't really needed


I would advise getting as much RAM as you possibly can. You can't upgrade later, so get as much as you can afford.

Mine is 64GB, and my memory pressure goes into the red when running a quantized 70B model with a dozen Chrome tabs open.


I use several LLM models locally for chat UIs and IDE autocompletions like copilot (continue.dev).

Between Teams, Chrome, VS Code, Outlook, and now LLMs my RAM usage sits around 20-22GB. 16GB will be a bottleneck to utility.


I've run LLMs and some of the various image models on my M1 Studio 32GB without issue. Not as fast as my old 3080 card, but considering the Mac all in has about a 5th the power draw, it's a lot closer than I expected. I'm not sure of the exact details but there is clearly some secret sauce that allows it to leverage the onboard NN hardware.


Mistral is _very_ small when quantized.

I’d still go with 16gbs


Is it easy to set this up?


Super easy. You can just head down to https://lmstudio.ai and pick up an app that lets you play around. It's not particularly advanced, but it works pretty well.

It's mostly optimized for M-series silicon, but it also technically works on Windows, and isn't too difficult to trick into working on Linux either.


Also, https://jan.ai is open source and worth trying out too.


Looks super cool, though it seems to be missing a good chunk of features, like the ability to change the prompt format. (Just installed it myself to check out all the options.) All the other missing stuff I can see though is stuff that LM Studio doesn't have either (such as a notebook mode). If it has a good chat mode then that's good enough for most!


It is, it doesn't require any setup.

After installation:

> ollama run mistral:latest


I've personally never been in a project where I've felt that the team was doing well thanks to scrum but in spite of it.


Most people that retire don't turn into murderers or anarchists. I find very interesting how people tend to picture the worst possible scenarios, maybe a lot of Movies or TV influence?


How about news? Look at what Paris looks like right now with a small minority of "aimless youths" and multiply that by 1000x


Technology that's putting those folks out of work (and into rioting, etc.) will also provide the tools to repress them. I don't like it, but that's the way it seems to me. E.g. Hong Kong.


There will always be places with social revolts. Still a tiny tiny fraction of how it was in the past.

Watching news can distort your perspective very quickly.


So 'now' has a problem. We have no means to know if our social environment is actually stable or not. Currently we are in a long 'peace' after WWII. Maybe it will remain, and improving technology will improve our lives and and things will continue to remain stable. Or, we'll have further climate instability coupled with AI labor displacement and things will go to shit faster than they ever have in history.

The point is people that believe the world will be stable in the future are more apt to build a stable future. If everyone is watching the news and they believe the future will be unstable, then the future will become unstable as a self fulfilling prophecy.


I think that's a very limited view.

A lot of people that retire from their careers pursue other interests that fulfill their needs, maybe it will be the era of amateur artists everywhere. Others prefer to manually do tasks that can be automated.

Others could engage in cooperation with robots because humans will always have creative desires.


Amature artists doing what? Trying to figure out why human greed is insatiable, therefore they have no place to live?

There are any number of problems that have to be solved together. Giving the capital class hyper powerful AI robots so they can own the world while everyone else suffers is an AI risk.


You can get far with htmx and any server template language. Common patterns are already encoded as html attributes.


Most framework devs don't have any incentive to stop adding features. What was a simple and elegant tool ends up trying to do much more and the additional complexity negates a lot of the benefits.


A dynamic routine that can run in a secure sandbox invoked from the host.


I think total disconnection on weekends cause more stress on Mondays and that's why most people hate them, you need a lot more cognitive effort to resume work.


I can already see AI Doomers predicting total catastrophe from this project.


Fittingly, there are AI Doomer bots on Chirper itself predicting total catastrophe...


The study group were mostly customer support agents. The nature of that work is very different from other knowledge workers so probably the results don't map to more creative fields.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: