The name is a prefix of the most popular website in the niche: thereisanaiforthat.com. Maybe some shady SEO tactic?
There are tons of these. Many of them are quite fishy -- they often reach out to you offering you to list your tool for a fee -- there are only a few directories where it's worth to do so.
Meta provides open source code to modify the the weights (fine tune the model). In this context, fine-tuning the model is better converted to being able to modify the code of the game.
So do video game developers (provide source code to modify their games) the analogy absolutely works. I can list a huge amount of actually open source software that I can see the source code and data for which is very different from Llama etc.
In terms of inference and interface (since you mentioned comfy) there are many truly open source options such as vLLM (though there isn't a single really performant open source solution for inference yet).
It's much better than sharing a binary artifact of regular software, since the weights can be and are easily and frequently modified by fine tuning the model. This means you can modify the "binary artifact" to your needs, similar to how you might change the code of open source software to add features etc.
They specifically call out fp8 aware training and TensoRT LLM is really good (efficient) with fp8 inference on H100 and other hopper cards. It's possible that they run the 7b natively in fp16 as smaller models suffer more from even "modest" quantization like this.
People arguing that this is "just extension" are ignoring the fact that extensions have special priviledges compared to websites, and you would not want all websites to have the full power of arbitrary extension.
If it's "just extension", make it available to all domains.
It has fp8 support. Not sure whether fp8 on MI300x is supported by vLLM yet.
Also, many of these comparisons use vLLM for both setups, but for Nvidia you can and should use TensorRT-LLM which tends to do quite a bit better than vLLM at high loads.
