Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
oblio
9 days ago
|
parent
|
context
|
favorite
| on:
New LLM optimization technique slashes memory cost...
My joke was more along the lines of entropy. Entropy is information and you can't throw away all of it, otherwise you have nothing useful left.
vlovich123
9 days ago
|
next
[–]
Modern LLMs are still quite inefficient in their representation of information. We're at like the DEFLATE era and we've still yet to invent zstd where there's only marginal incremental gains; so right now there's a lot of waste to prune away.
reply
lxgr
9 days ago
|
prev
[–]
Hence the idea to only throw away almost all of it.
reply
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
