Hacker News new | past | comments | ask | show | jobs | submit login

It's not really a lie though. They require 20x more chips (storing all the weights in sram instead of hbm is expensive!) than Nvidia GPUs for a ~2x speed increase. Overall the power cost is more expensive for groq than GPUs.



Are power and 20x 14-nm chip capacity limiting factors currently?

It's not inconceivable that's a better trade-off than leading-node and HBM requirements.


Edit: 200x more chips, not 20x.


Source? Or how do you know that?


This was discussed extensively in previous threads, e.g. https://news.ycombinator.com/item?id=39431989




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: