I also have this question, yes it should be. The forward pass should require acc... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

w1nk on March 31, 2023 | parent | context | favorite | on: Llama.cpp 30B runs with only 6GB of RAM now

I also have this question, yes it should be. The forward pass should require accessing all the weights AFAIK.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact