Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
asylteltine
on June 19, 2023
|
parent
|
context
|
favorite
| on:
OpenLLM
What does it mean to “serve a model”? Where exactly does the request go and how does it interface with the model?
thecal
on June 19, 2023
[–]
Think of the model as a gigantic compiled binary where you send in strings in a certain format and get back a response. This is a web API wrapper for that so you only need an HTTP client instead of having to run something like llama.cpp yourself.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
