Hacker News new | past | comments | ask | show | jobs | submit login

Whisper JAX is an optimised implementation of the Whisper model by OpenAI. It runs on JAX with a TPU v4-8 in the backend. Compared to PyTorch on an A100 GPU, it is over 70x faster, making it the fastest Whisper API available.



how does it compare to whisper.cpp?


Not a good comparison. CPU vs TPU. Also, whisper.cpp perf varies a ton depending on hardware. Avx512 or neural engine?


70 times faster




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: