My mac mini is heavily constrained due to only having 2 proper cores and not much RAM. So the smallest models run best. The quantized tiny runs better than the regular tiny simply due to memory pressure.
So, in my testing on my mac mini it tends to take about 30% more time to process than the audio clip that was recorded. I added a specific warning that lets the user know to reduce their thread count if the processing time takes longer than a specific threshold.
Some of my stream viewers report it being pretty fast though. (much faster than what they see on my mac mini).
Basically, I want to write a book without having to type out the whole thing. I got the dictation idea from an episode of Columbo.
It is very much a work in progress and a proof of concept for another writing tool I want to make.
https://orderly.cmgriffing.com/
https://github.com/cmgriffing/orderly