Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
woadwarrior01
on June 11, 2024
|
parent
|
context
|
favorite
| on:
Apple's On-Device and Server Foundation Models
I'm the author of Private LLM. Looks like it's just become possible[1] to run quantized LLM inference using the ANE with iOS 18. I think there are some major efficiency gains on the table now.
[1]:
https://github.com/apple/coremltools/pull/2232
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
[1]: https://github.com/apple/coremltools/pull/2232