Can you clarify the 50x cheaper number? Is this for self-hosting, or if you're h... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

derekpankaew on Sept 12, 2023 | parent | context | favorite | on: Fine-tune your own Llama 2 to replace GPT-3.5/4

Can you clarify the 50x cheaper number? Is this for self-hosting, or if you're hosting on OpenPipe?

The pricing on OpenPipe says it's 0.0012 to 0.0016 per 1K tokens for Llama 7b. GPT-3.5 pricing is 0.0015 to 0.002, so not that different.

I'm assuming the 50x cost reductions are primarily from self-hosting?

kcorbitt on Sept 12, 2023 [–]

Yep, the 50x cost reduction is if you self-host a fine-tuned model using the setup demonstrated in in the linked notebooks.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact