Because that is way less clean of a solution and would be a total pain to carry around

I’m the author of the post and will also be releasing an open source speech to text app in the coming weeks. It’s what I’ve been using for months, but packaging it for people

It’s going to be extremely simple, and hopefully easy enough to use. MIT licensed, free

Can you tell me more about the "anonymous federated score sharing"? Maybe something we can think about more

I totally agree with Ollama integration and if there is interest we will try to upstream into llama.cpp

Right now the main priority is just getting the data out, but in the future may have some interest in this. Or perhaps we can open an API for others to build this as well

I think you might be right, definitely interested in this feedback and creating charts and graphs that are the most useful for folks!

It's kind of just an artifact of the development. Happy to switch the default models and sizes in the future especially based on community feedback

LocalScore dev here

Thank you! I think this is quite possible! If you don't mind starting a discussion on this I would love to think aloud there

https://github.com/cjpais/LocalScore/discussions

LocalScore dev here

Llamafile could certainly be released without the GPU binaries included by default and it would slim down the size tremendously.

The extra 70MiB is that the CUDA binaries for LocalScore are built with CuBLAS and for more generations of NVIDIA architectures (sm60->sm120), whereas Llamafile is built with TinyBLAS and for just a few generations in particular

I think it's possible to randomize weights with a standard set of layers, and maybe a possibility for the future

Ty for pointing this out, the results are taken from the db based on LocalScore, I will make some modifications to make the sorting better here

adsb.lol airplanes.live

adsbexchange was also bought out by private equity recently, these two seem to be some of the larger fully community driven resources.

Oh yes exchange that was the one I meant that was sold off, sorry.

I'll check those out thanks!