Could you explain more on how to do this? e.g if I am using the Claude API in my... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

its_down_again 33 days ago | parent | context | favorite | on: Amazon to invest another $4B in Anthropic

Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inference endpoint?

handfuloflight 33 days ago | [–]

You can't. He means by using the open source models.

datavirtue 33 days ago | [–]

Runa local LLM tuned for coding on LM Studio. It has a server and provides endpoints.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact