Hacker News new | past | comments | ask | show | jobs | submit login

You need enough VRAM to hold the whole thing plus context. So probably a bunch of H100s, or MI300s.



Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: