Hacker News new | past | comments | ask | show | jobs | submit login
How Fast Does the Jetson Nano Run Large Language Models? (jeremymorgan.com)
4 points by amrrs 38 days ago | hide | past | favorite | 1 comment



> We’re only testing models up to 4b, as larger ones don’t run well on this Jetson.

According to spec, this model has 4GB 64-bit LPDDR4 (25.6GB/s) memory




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: