The embeddings can be based on a different model to the one you pass them as con... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

bigfudge on May 22, 2023 | parent | context | favorite | on: PrivateGPT

The embeddings can be based on a different model to the one you pass them as context to. So you could upgrade the summmariser model without upgrading the embeddings.

santiagobasulto on May 22, 2023 [–]

But you'd need to keep both models in parallel, right? Using M1 to keep computing embeddings and using M2 for completions.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact